00000001:02000400:2.0F:1784045088.348316:0:3297:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_hostid 00000001:02000400:2.0:1784045097.097176:0:3499:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1784045098.182093:0:3562:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1271 MB/s 00000001:01000000:2.0:1784045098.431557:0:3562:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1487 MB/s 00000001:01000000:2.0:1784045098.681523:0:3562:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9327 MB/s 00000020:02000000:2.0:1784045099.008415:0:3592:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_g336b9c0 00000400:02000000:0.0F:1784045099.403296:0:3607:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.203.144@tcp [8/256/0/180] 00008000:02000000:0.0:1784045103.157901:0:3756:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0F:1784045169.111130:0:5723:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784045182.767363:0:6473:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784045182.767371:0:6473:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784045182.767373:0:6473:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784045182.767550:0:6473:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000ce75dedb 00000080:02000400:2.0:1784045182.767561:0:6473:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1784045182.777026:0:6473:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1784045182.777042:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784045182.777077:0:6473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000f1a8e1c2) 00000020:00000080:2.0:1784045182.777097:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784045182.854441:0:6473:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1784045182.860048:0:6473:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1784045182.909851:0:6473:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784045182.910686:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784045182.910695:0:6473:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784045182.910709:0:6473:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454c0be 00000020:01000004:2.0:1784045182.910716:0:6473:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1784045182.910721:0:6473:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1784045182.910726:0:6473:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ce75dedb from MGS 00000020:01000004:2.0:1784045182.910731:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1784045182.910754:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000006a2f29a4) 00000020:00000080:2.0:1784045182.910766:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1784045182.910827:0:6473:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ce75dedb from MGS, refs=2 00080000:01000000:2.0:1784045182.910833:0:6473:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784045182.910837:0:6473:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454c0cc 00000100:00100000:2.0:1784045182.910960:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1784045182.911752:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1784045182.911760:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784045182.914317:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784045182.914334:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1784045182.915111:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784045182.915296:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1784045182.915301:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1784045182.916196:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1784045182.916205:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1784045182.916781:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1784045182.916788:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1784045182.917682:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045182.917686:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045182.917695:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045182.917965:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045182.917967:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045182.917969:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045182.918611:0:6473:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1784045182.927086:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1784045183.167965:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2375 MB/s 00000001:01000000:3.0:1784045183.417512:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3399 MB/s 00000001:01000000:2.0:1784045183.668004:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 623 MB/s 00000001:01000000:2.0:1784045183.917556:0:6473:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 731 MB/s 00080000:10000000:2.0:1784045183.932576:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1784045183.959122:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1784045183.959778:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784045183.960884:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784045183.961070:0:6473:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784045183.961119:0:6473:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1784045183.961287:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784045183.961312:0:6473:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784045183.961709:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784045183.963461:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784045183.963471:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784045183.964283:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784045183.964293:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1784045183.968379:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1784045183.968392:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1784045183.986268:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784045183.986297:0:6473:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.144@tcp' 00000020:01000004:2.0:1784045183.986299:0:6473:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1784045183.986357:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.144@tcp (typ=mgc) 00000020:00000080:2.0:1784045183.986369:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.144@tcp (00000000900938ef) 00000020:00000080:2.0:1784045183.986387:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1784045183.986501:0:6473:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000834fcd15@MGC192.168.203.144@tcp: add connection 192.168.203.144@tcp at head 00010000:00010000:2.0:1784045183.986707:0:6473:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.144@tcp-0 is initialized 00000040:01000000:2.0:1784045183.986714:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 1 is initialized 00000100:00080000:3.0:1784045183.993550:0:6492:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1784045183.999050:0:6493:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1784045184.000032:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.144@tcp (uuid 0e855152-ca69-43a0-b465-3bf4e35d62f0) 00000020:00000080:2.0:1784045184.000057:0:6473:0:(genops.c:1406:class_connect()) connect: client 0e855152-ca69-43a0-b465-3bf4e35d62f0, cookie 0x5475624df454c0da 00000100:00080000:2.0:1784045184.000071:0:6473:0:(import.c:510:import_select_connection()) MGC192.168.203.144@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784045184.000077:0:6473:0:(import.c:624:import_select_connection()) MGC192.168.203.144@tcp: import 00000000834fcd15 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045184.000136:0:6473:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005eed530f x1870706873729152/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045184.000160:0:6473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0e855152-ca69-43a0-b465-3bf4e35d62f0->MGS 00000020:01000004:2.0:1784045184.000184:0:6473:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784045184.000191:0:6473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1784045184.000205:0:6473:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c4f863fa) 00000020:00000080:2.0:1784045184.000218:0:6473:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0F:1784045184.001242:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005eed530f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e855152-ca69-43a0-b465-3bf4e35d62f0:3622:1870706873729152:0@lo:250: 00000100:00100000:1.0:1784045184.001313:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045184.009704:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873729152 00000100:00100000:1.0:1784045184.009721:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873729152 00000100:00100000:1.0:1784045184.011819:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045184.011830:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065f3cdd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3622:x1870706873729152:12345-0@lo:250: 00010000:00080000:1.0:1784045184.011871:0:6488:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 0e855152-ca69-43a0-b465-3bf4e35d62f0@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:1.0:1784045184.011918:0:6488:0:(genops.c:1406:class_connect()) connect: client 0e855152-ca69-43a0-b465-3bf4e35d62f0, cookie 0x5475624df454c0e8 00000100:00080000:1.0:1784045184.012066:0:6488:0:(import.c:65:import_set_state_nolock()) 0000000097471db2 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784045184.012173:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065f3cdd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:3622:x1870706873729152:12345-0@lo:250: Request processed in 343us (10860us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045184.012182:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045184.012331:0:3622:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.144@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1784045184.012342:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.144@tcp: connect to target with instance 0 00000100:00080000:2.0:1784045184.012349:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.144@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784045184.012355:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784045184.012358:0:3622:0:(import.c:65:import_set_state_nolock()) 00000000834fcd15 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784045184.012361:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784045184.012377:0:3622:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784045184.012382:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005eed530f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e855152-ca69-43a0-b465-3bf4e35d62f0:3622:1870706873729152:0@lo:250: 00000100:00100000:1.0:1784045184.021545:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045184.021765:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784045184.021772:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1784045184.025577:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1784045184.025596:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1784045184.026236:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1784045184.026244:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1784045184.029048:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045184.029281:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784045184.029289:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1784045184.030725:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1784045184.031302:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1784045184.102724:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784045184.103818:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1784045184.103830:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1784045184.107403:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1784045184.107422:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1784045184.108404:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784045184.109371:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784045184.109378:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1784045184.112985:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784045184.113000:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784045184.114037:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045184.114342:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784045184.114349:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1784045184.115168:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784045184.115176:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1784045184.115755:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045184.115929:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784045184.115935:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1784045184.120866:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784045184.120885:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1784045184.146291:0:6473:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784045184.146750:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784045184.146759:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1784045184.149318:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784045184.149337:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1784045184.153664:0:6473:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784045184.153681:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784045184.155295:0:6473:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784045184.155327:0:6473:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1784045184.155333:0:6473:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784045184.155438:0:6473:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784045184.155679:0:6473:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.144@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1784045184.155684:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784045184.155686:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784045184.155692:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045184.155693:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045184.155694:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045184.155695:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045184.155696:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784045184.155701:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784045184.155702:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784045184.155703:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784045184.155705:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045184.155706:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784045184.155709:0:6473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1784045184.155712:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784045184.155713:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784045184.155713:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045184.155714:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045184.155715:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045184.155716:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045184.155717:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784045184.155717:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784045184.155718:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784045184.155719:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784045184.155719:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045184.155720:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784045184.155776:0:6473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784045184.155797:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fda79b7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873729280:0@lo:253: 00000100:00100000:3.0:1784045184.157306:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045184.157375:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eb3a8c05 going to sleep for 11 seconds 00000100:00100000:2.0:1784045184.158024:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873729280 00000100:00100000:2.0:1784045184.158037:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873729280 00000100:00100000:2.0:1784045184.158157:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784045184.158168:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049aa8f78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:6473:x1870706873729280:12345-0@lo:253: 20000000:01000000:2.0:1784045184.158234:0:6490:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784045184.158238:0:6490:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1784045184.158731:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784045184.158806:0:6490:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1784045184.159204:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045184.160757:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1784045184.161052:0:6490:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784045184.161056:0:6490:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1784045184.161062:0:6490:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1784045184.161066:0:6490:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1784045184.161079:0:6490:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1784045184.161331:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045184.161706:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1784045184.161720:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784045184.161749:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1784045184.161766:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1784045184.161781:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1784045184.161851:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1784045184.161861:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1784045184.161875:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1784045184.161881:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1784045184.161892:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1784045184.161897:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1784045184.161909:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1784045184.161937:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1784045184.161965:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1784045184.161971:0:6490:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1784045184.161978:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045184.162065:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1784045184.162075:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784045184.162090:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1784045184.162103:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1784045184.162116:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1784045184.162125:0:6490:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1784045184.162152:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1784045184.162161:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1784045184.162175:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1784045184.162191:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1784045184.162207:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1784045184.162283:0:6490:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1784045184.162311:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1784045184.162320:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1784045184.162333:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1784045184.162348:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1784045184.162426:0:6490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1784045184.162546:0:6490:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1784045184.162553:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1784045184.165309:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1784045184.167874:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1784045184.167984:0:6490:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.144@tcp for mdt 20000000:01000000:2.0:1784045184.167987:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:2.0:1784045184.168167:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1784045184.168175:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1784045184.168188:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1784045184.168194:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:2.0:1784045184.168207:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1784045184.168277:0:6490:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1784045184.168295:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1784045184.168310:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1784045184.168343:0:6490:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784045184.168346:0:6490:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784045184.168350:0:6490:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784045184.168396:0:6490:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784045184.168398:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784045184.168865:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1784045184.169072:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1784045184.169087:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1784045184.169095:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1784045184.169100:0:6490:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784045184.169101:0:6490:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784045184.169513:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1784045184.169720:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1784045184.169749:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1784045184.169769:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1784045184.169780:0:6490:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784045184.169783:0:6490:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1784045184.169786:0:6490:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1784045184.169789:0:6490:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1784045184.169794:0:6490:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1784045184.169807:0:6490:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1784045184.171100:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1784045184.171205:0:6490:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1784045184.182390:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1784045184.182428:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1784045184.182440:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1784045184.182814:0:6490:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784045184.182934:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000315b1ab5/0x5475624df454c0ef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045184.182955:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000315b1ab5/0x5475624df454c0ef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045184.182967:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000315b1ab5/0x5475624df454c0ef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045184.182991:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000315b1ab5/0x5475624df454c0ef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045184.182996:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000315b1ab5/0x5475624df454c0ef lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045184.183002:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000315b1ab5/0x5475624df454c0ef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045184.183009:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000315b1ab5 already unused, calling callback (0000000010207b6b) 00010000:00010000:3.0:1784045184.183013:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000315b1ab5/0x5475624df454c0ef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045184.183020:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000315b1ab5/0x5475624df454c0ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045184.183035:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000315b1ab5/0x5475624df454c0ef lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045184.183043:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000315b1ab5/0x5475624df454c0ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045184.183049:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000315b1ab5/0x5475624df454c0ef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784045184.183067:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784045184.195845:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049aa8f78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:6473:x1870706873729280:12345-0@lo:253: Request processed in 37671us (38539us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045184.195870:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045184.196023:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fda79b7d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873729280:0@lo:253: 10000000:01000000:0.0:1784045184.196042:0:6473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784045184.196045:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784045184.196048:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784045184.196050:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045184.196051:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1784045184.196053:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045184.196054:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045184.196055:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045184.196057:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784045184.196059:0:6473:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784045184.196060:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045184.196061:0:6473:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784045184.196084:0:6473:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ce75dedb from lustre-MDT0000 10000000:01000000:0.0:1784045184.196298:0:6473:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784045184.196302:0:6473:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784045184.196307:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff939c901d3380 10000000:01000000:0.0:1784045184.196311:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784045184.196320:0:6473:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff939c901d3380 from 1 10000000:01000000:0.0:1784045184.196324:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784045184.196710:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.196722:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.196742:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045184.196767:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000737c44b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873729408:0@lo:101: 00000100:00100000:0.0:1784045184.196844:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045184.196900:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f81fd6b6 going to sleep for 11 seconds 00000100:00100000:1.0:1784045184.197021:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873729408 00000100:00100000:1.0:1784045184.197029:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873729408 00000100:00100000:1.0:1784045184.197095:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784045184.197109:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003edd31b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:6473:x1870706873729408:12345-0@lo:101: 00010000:00010000:1.0:1784045184.197314:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045184.197330:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a354933f/0x5475624df454c0fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c0f6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.197417:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a354933f/0x5475624df454c0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c0f6 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.197429:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a354933f/0x5475624df454c0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c0f6 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.197438:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a354933f, rc 0) 00000100:00100000:1.0:1784045184.197517:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003edd31b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+6:6473:x1870706873729408:12345-0@lo:101: Request processed in 408us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045184.197524:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045184.197730:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000737c44b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873729408:0@lo:101: 00010000:00010000:0.0:1784045184.197754:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c0fd expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.197763:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c0fd expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045184.197824:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000737c44b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873729536:0@lo:501: 00000100:00100000:0.0:1784045184.197852:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045184.197877:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f81fd6b6 going to sleep for 11 seconds 00000100:00100000:3.0:1784045184.197933:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873729536 00000100:00100000:3.0:1784045184.197948:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873729536 00000100:00100000:3.0:1784045184.198003:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784045184.198010:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f71872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+6:6473:x1870706873729536:12345-0@lo:501: 00000100:00100000:3.0:1784045184.198273:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f71872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+6:6473:x1870706873729536:12345-0@lo:501: Request processed in 263us (420us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784045184.198280:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045184.199581:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000737c44b7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873729536:0@lo:501: 10000000:01000000:1.0:1784045184.199630:0:6473:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784045184.199648:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c0fd expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.199659:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c0fd expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045184.199669:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff939c9775c000 10000000:01000000:1.0:1784045184.199676:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784045184.199681:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff939c9775c000 10000000:01000000:1.0:1784045184.199683:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784045184.199686:0:6473:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff939c9775c000 from 1 10000000:01000000:1.0:1784045184.199699:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784045184.199754:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000cc22db06/0x5475624df454c104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.199762:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000cc22db06/0x5475624df454c104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.199771:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000cc22db06/0x5475624df454c104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045184.199788:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000308e32c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873729664:0@lo:101: 00000100:00100000:1.0:1784045184.199842:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045184.199884:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b4485fe going to sleep for 11 seconds 00000100:00100000:0.0:1784045184.199986:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873729664 00000100:00100000:0.0:1784045184.200003:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873729664 00000100:00100000:0.0:1784045184.200074:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045184.200082:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f41f59f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+6:6473:x1870706873729664:12345-0@lo:101: 00010000:00010000:0.0:1784045184.200096:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045184.200125:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bfe18b54/0x5475624df454c10b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c104 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.200146:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bfe18b54/0x5475624df454c10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c104 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.200154:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bfe18b54/0x5475624df454c10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c104 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.200163:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bfe18b54, rc 0) 00000100:00100000:0.0:1784045184.200202:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f41f59f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+7:6473:x1870706873729664:12345-0@lo:101: Request processed in 121us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045184.200213:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784045184.201300:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000308e32c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873729664:0@lo:101: 00010000:00010000:1.0:1784045184.201324:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000cc22db06/0x5475624df454c104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.201335:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000cc22db06/0x5475624df454c104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045184.201428:0:6473:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784045184.201463:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000cc22db06/0x5475624df454c104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.201470:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000cc22db06/0x5475624df454c104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045184.201478:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784045184.201484:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784045184.201491:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff939c9775c000 10000000:01000000:1.0:1784045184.201503:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784045184.201506:0:6473:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784045184.201509:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784045184.201535:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.201542:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.201549:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045184.201565:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000308e32c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873729792:0@lo:101: 00000100:00100000:1.0:1784045184.201760:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045184.201796:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b4485fe going to sleep for 11 seconds 00000100:00100000:0.0:1784045184.201919:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873729792 00000100:00100000:0.0:1784045184.201926:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873729792 00000100:00100000:0.0:1784045184.201970:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045184.201979:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000841a10cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+7:6473:x1870706873729792:12345-0@lo:101: 00010000:00010000:0.0:1784045184.202001:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045184.202015:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e918a6c5/0x5475624df454c119 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c112 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.202034:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e918a6c5/0x5475624df454c119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c112 expref: 8 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.202043:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e918a6c5/0x5475624df454c119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c112 expref: 8 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.202050:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e918a6c5, rc 0) 00000100:00100000:0.0:1784045184.202106:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000841a10cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+8:6473:x1870706873729792:12345-0@lo:101: Request processed in 122us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045184.202112:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784045184.202205:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000308e32c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873729792:0@lo:101: 00010000:00010000:3.0:1784045184.202219:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c119 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045184.202226:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c119 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045184.202313:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cfbf182e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873729920:0@lo:501: 00000100:00100000:3.0:1784045184.202342:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045184.202423:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 000000002b91dc9a going to sleep for 11 seconds 00000100:00100000:0.0:1784045184.202531:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873729920 00000100:00100000:0.0:1784045184.202534:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873729920 00000100:00100000:0.0:1784045184.202544:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045184.202547:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000050d92f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+8:6473:x1870706873729920:12345-0@lo:501: 00000100:00100000:0.0:1784045184.202833:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000050d92f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+9:6473:x1870706873729920:12345-0@lo:501: Request processed in 284us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045184.202840:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045184.203018:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cfbf182e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873729920:0@lo:501: 00000100:00100000:3.0:1784045184.203047:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cfbf182e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873730048:0@lo:503: 00000100:00100000:3.0:1784045184.203278:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045184.203308:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 000000002b91dc9a going to sleep for 11 seconds 00000100:00100000:0.0:1784045184.203428:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873730048 00000100:00100000:0.0:1784045184.203433:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873730048 00000100:00100000:0.0:1784045184.203503:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784045184.203509:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a32441a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+9:6473:x1870706873730048:12345-0@lo:503: 00000100:00100000:0.0:1784045184.203756:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a32441a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+9:6473:x1870706873730048:12345-0@lo:503: Request processed in 246us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045184.203765:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784045184.203843:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cfbf182e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873730048:0@lo:503: 00000100:00100000:0.0:1784045184.204686:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000072c5da2a pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:6518:1870706873730176:0@lo:502: 00000100:00100000:0.0:1784045184.204751:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045184.204820:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000763380fe going to sleep for 11 seconds 00000100:00100000:1.0:1784045184.204852:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873730176 00000100:00100000:1.0:1784045184.204858:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873730176 00000100:00100000:1.0:1784045184.204926:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784045184.204933:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6f6ae86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+9:6518:x1870706873730176:12345-0@lo:502: 00000100:00100000:1.0:1784045184.205344:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6f6ae86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+9:6518:x1870706873730176:12345-0@lo:502: Request processed in 411us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045184.205350:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784045184.207307:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000072c5da2a pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:6518:1870706873730176:0@lo:502: 00000020:01000000:2.0:1784045184.207358:0:6518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045184.207372:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045184.207375:0:6518:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784045184.207380:0:6518:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784045184.207384:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045184.207504:0:6518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ee967490) 00000020:00000080:2.0:1784045184.207527:0:6518:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1784045184.207534:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784045184.207632:0:6518:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784045184.207647:0:6518:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454c127 00000020:00000080:3.0:1784045184.208351:0:6518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784045184.208358:0:6518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045184.208363:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045184.208365:0:6518:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784045184.208368:0:6518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045184.208373:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045184.208380:0:6518:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1784045184.208384:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784045184.208564:0:6518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000229d1dec) 00000020:00000080:3.0:1784045184.208593:0:6518:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1784045184.208600:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784045184.208602:0:6518:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1784045184.208605:0:6518:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1784045184.208612:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784045184.208839:0:6518:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ce75dedb from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784045184.208866:0:6518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000f35c4c4) 00000020:00000080:3.0:1784045184.208875:0:6518:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1784045184.209015:0:6518:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784045184.209020:0:6518:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454c13c 00000020:00000080:3.0:1784045184.209296:0:6518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784045184.209304:0:6518:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784045184.209309:0:6518:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5475624df454c143 00080000:01000000:3.0:1784045184.209315:0:6518:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784045184.209319:0:6518:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454c14a 00080000:10000000:3.0:1784045184.210049:0:6518:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1784045184.210316:0:6518:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1784045184.218322:0:6518:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1784045184.313776:0:6518:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1784045184.314149:0:6518:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1784045184.316927:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1784045184.317405:0:6518:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1784045184.320901:0:6518:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000cfc51f30) 00000020:00000080:1.0:1784045184.320928:0:6518:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1784045184.321094:0:6518:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1784045184.321104:0:6518:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454c158 00000020:00000080:1.0:1784045184.323712:0:6518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1784045184.324896:0:6518:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1784045184.328306:0:6518:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1784045184.332396:0:6518:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1784045184.344187:0:6518:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1784045184.347131:0:6518:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1784045184.349811:0:6518:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1784045184.352105:0:6518:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5475624df454c15f 00000020:00000080:2.0:1784045184.352643:0:6518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784045184.352657:0:6518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045184.352798:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045184.352802:0:6518:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784045184.352806:0:6518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045184.352811:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045184.352812:0:6518:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784045184.352816:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784045184.352818:0:6518:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784045184.352820:0:6518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045184.352822:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045184.352823:0:6518:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784045184.352825:0:6518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045184.352829:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045184.352830:0:6518:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784045184.352841:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784045184.352887:0:6518:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1784045184.352949:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cfbf182e pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:6518:1870706873730304:0@lo:502: 00000100:00100000:3.0:1784045184.353114:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045184.353212:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f5b50e58 going to sleep for 11 seconds 00000100:00100000:2.0:1784045184.353288:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873730304 00000100:00100000:2.0:1784045184.353294:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873730304 00000100:00100000:2.0:1784045184.353376:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045184.353385:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f26f0ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+9:6518:x1870706873730304:12345-0@lo:502: 00000100:00100000:2.0:1784045184.353818:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f26f0ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+9:6518:x1870706873730304:12345-0@lo:502: Request processed in 434us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045184.353827:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784045184.353950:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cfbf182e pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:6518:1870706873730304:0@lo:502: 00000020:01000000:3.0:1784045184.353981:0:6518:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045184.353987:0:6518:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045184.353989:0:6518:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1784045184.354004:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1784045184.354283:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1784045184.354313:0:6473:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784045184.354367:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c119 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.354379:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c119 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045184.354387:0:6473:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939c9775c000 from 1 10000000:01000000:1.0:1784045184.354390:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784045184.354437:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.354471:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.354480:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045184.354498:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000538345fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873730432:0@lo:101: 00000100:00100000:1.0:1784045184.354540:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045184.354569:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 000000002726f53f going to sleep for 11 seconds 00000100:00100000:2.0:1784045184.354704:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873730432 00000100:00100000:2.0:1784045184.354710:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873730432 00000100:00100000:2.0:1784045184.354750:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784045184.354757:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d988f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+9:6473:x1870706873730432:12345-0@lo:101: 00010000:00010000:2.0:1784045184.354768:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045184.354783:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003caf6fef/0x5475624df454c16d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c166 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.354804:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003caf6fef/0x5475624df454c16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c166 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.354824:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003caf6fef/0x5475624df454c16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c166 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.354832:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003caf6fef, rc 0) 00000100:00100000:2.0:1784045184.354885:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d988f09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+10:6473:x1870706873730432:12345-0@lo:101: Request processed in 129us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045184.354891:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784045184.355014:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000538345fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873730432:0@lo:101: 00010000:00010000:1.0:1784045184.355028:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c16d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.355036:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c16d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045184.359262:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000538345fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873730560:0@lo:256: 00000100:00100000:1.0:1784045184.359354:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045184.360712:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 000000002726f53f going to sleep for 11 seconds 00000100:00100000:2.0:1784045184.361217:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873730560 00000100:00100000:2.0:1784045184.361229:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873730560 00000100:00100000:2.0:1784045184.361292:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784045184.361303:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018e9dbb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+10:6473:x1870706873730560:12345-0@lo:256: 20000000:01000000:2.0:1784045184.361332:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784045184.361339:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784045184.361487:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018e9dbb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+10:6473:x1870706873730560:12345-0@lo:256: Request processed in 187us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045184.361496:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784045184.361712:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000538345fb pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873730560:0@lo:256: 10000000:01000000:0.0:1784045184.362380:0:6473:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784045184.362603:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c16d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.362616:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c16d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045184.362625:0:6473:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939c9775c000 from 1 10000000:01000000:0.0:1784045184.362628:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784045184.362664:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.362672:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.362681:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045184.362703:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000407f5f9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873730688:0@lo:101: 00000100:00100000:0.0:1784045184.362780:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045184.362822:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 000000006b4d7006 going to sleep for 11 seconds 00000100:00100000:0.0:1784045184.362847:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873730688 00000100:00100000:0.0:1784045184.362853:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873730688 00000100:00100000:0.0:1784045184.362889:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045184.362896:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005940db5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+10:6473:x1870706873730688:12345-0@lo:101: 00010000:00010000:0.0:1784045184.362907:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045184.362921:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f369aef1/0x5475624df454c17b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c174 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.362942:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f369aef1/0x5475624df454c17b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c174 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.362952:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f369aef1/0x5475624df454c17b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c174 expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.362959:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f369aef1, rc 0) 00000100:00100000:0.0:1784045184.363128:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005940db5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+11:6473:x1870706873730688:12345-0@lo:101: Request processed in 232us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045184.363135:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045184.363180:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000407f5f9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873730688:0@lo:101: 00010000:00010000:0.0:1784045184.363193:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c17b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.363201:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c17b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045184.363261:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000407f5f9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873730816:0@lo:501: 00000100:00100000:0.0:1784045184.363298:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045184.363554:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 000000006b4d7006 going to sleep for 11 seconds 00000100:00100000:3.0:1784045184.363871:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873730816 00000100:00100000:3.0:1784045184.363877:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873730816 00000100:00100000:3.0:1784045184.363951:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784045184.363958:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052a1084a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+11:6473:x1870706873730816:12345-0@lo:501: 00000100:00100000:3.0:1784045184.364204:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052a1084a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+11:6473:x1870706873730816:12345-0@lo:501: Request processed in 247us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045184.364212:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784045184.364751:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000407f5f9c pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873730816:0@lo:501: 00000100:00100000:1.0:1784045184.364801:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000022db51be pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873730944:0@lo:503: 00000100:00100000:1.0:1784045184.364860:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045184.364895:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cb9aa5a5 going to sleep for 11 seconds 00000100:00100000:3.0:1784045184.364945:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873730944 00000100:00100000:3.0:1784045184.364950:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873730944 00000100:00100000:3.0:1784045184.364998:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784045184.365004:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d4244a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+11:6473:x1870706873730944:12345-0@lo:503: 00000040:00080000:3.0:1784045184.365042:0:6490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784045184.365081:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d4244a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+11:6473:x1870706873730944:12345-0@lo:503: Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045184.365087:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784045184.365322:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000022db51be pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873730944:0@lo:503: 00000040:00080000:1.0:1784045184.366603:0:6522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1784045184.366771:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1784045184.366795:0:6473:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784045184.366853:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c17b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.366867:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c17b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045184.366917:0:6473:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784045184.366920:0:6473:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff939c9775c000 10000000:01000000:0.0:1784045184.366924:0:6473:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff939c9775c000 10000000:01000000:0.0:1784045184.366928:0:6473:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784045184.366934:0:6473:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939c9775c000 from 1 10000000:01000000:0.0:1784045184.366937:0:6473:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784045184.366968:0:6473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.366976:0:6473:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.366985:0:6473:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045184.367015:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000523c27e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873731072:0@lo:101: 00000100:00100000:0.0:1784045184.367078:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045184.367123:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f81fd6b6 going to sleep for 11 seconds 00000100:00100000:1.0:1784045184.367239:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873731072 00000100:00100000:1.0:1784045184.367245:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873731072 00000100:00100000:1.0:1784045184.367291:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784045184.367298:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d1cb06b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+11:6473:x1870706873731072:12345-0@lo:101: 00010000:00010000:1.0:1784045184.367313:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045184.367326:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038664a16/0x5475624df454c189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c182 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.367347:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038664a16/0x5475624df454c189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c182 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.367357:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038664a16/0x5475624df454c189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c182 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.367364:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038664a16, rc 0) 00000100:00100000:1.0:1784045184.367413:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d1cb06b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6473:x1870706873731072:12345-0@lo:101: Request processed in 116us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045184.367510:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045184.367685:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000523c27e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873731072:0@lo:101: 00010000:00010000:0.0:1784045184.367702:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c189 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045184.367722:0:6473:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c189 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045184.367810:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000523c27e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873731200:0@lo:501: 00000100:00100000:0.0:1784045184.367840:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045184.367905:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f81fd6b6 going to sleep for 11 seconds 00000100:00100000:1.0:1784045184.368190:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873731200 00000100:00100000:1.0:1784045184.368196:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873731200 00000100:00100000:1.0:1784045184.368257:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784045184.368271:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006acd453f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6473:x1870706873731200:12345-0@lo:501: 00000100:00100000:1.0:1784045184.368557:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006acd453f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6473:x1870706873731200:12345-0@lo:501: Request processed in 287us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045184.368565:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784045184.368707:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000523c27e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873731200:0@lo:501: 00000100:00100000:0.0:1784045184.368753:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000523c27e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873731328:0@lo:503: 00000100:00100000:0.0:1784045184.368797:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045184.368834:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f81fd6b6 going to sleep for 11 seconds 00000100:00100000:2.0:1784045184.368899:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873731328 00000100:00100000:2.0:1784045184.368904:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873731328 00000100:00100000:2.0:1784045184.368939:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784045184.368946:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032785bd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6473:x1870706873731328:12345-0@lo:503: 00000100:00100000:2.0:1784045184.369238:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032785bd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6473:x1870706873731328:12345-0@lo:503: Request processed in 293us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045184.369244:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045184.369322:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000523c27e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873731328:0@lo:503: 00000100:00100000:3.0:1784045184.370108:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cfbf182e pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:6523:1870706873731456:0@lo:502: 00000100:00100000:3.0:1784045184.370158:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045184.370232:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 000000003d9f9f9d going to sleep for 11 seconds 00000100:00100000:2.0:1784045184.370264:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873731456 00000100:00100000:2.0:1784045184.370270:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873731456 00000100:00100000:2.0:1784045184.370335:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784045184.370343:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fee785ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6523:x1870706873731456:12345-0@lo:502: 00000100:00100000:2.0:1784045184.370701:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fee785ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6523:x1870706873731456:12345-0@lo:502: Request processed in 359us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045184.370708:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784045184.370821:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cfbf182e pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:6523:1870706873731456:0@lo:502: 00000020:01000004:0.0:1784045184.370885:0:6523:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784045184.370911:0:6523:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007ac85ba3) 00000020:00000080:0.0:1784045184.370932:0:6523:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1784045184.371273:0:6523:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ce75dedb from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784045184.371278:0:6523:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ce75dedb from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784045184.371281:0:6523:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ce75dedb 4 00010000:00080000:0.0:1784045184.371312:0:6523:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002a7390d9@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:0.0:1784045184.379300:0:6523:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1784045184.380114:0:6523:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784045184.380171:0:6523:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784045184.380186:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5475624df454c197 00000100:00080000:0.0:1784045184.380199:0:6523:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784045184.380205:0:6523:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002a7390d9 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045184.380249:0:6523:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000523c27e x1870706873731584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784045184.380320:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000523c27e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1870706873731584:0@lo:38: 00000100:00100000:2.0:1784045184.380414:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045184.380558:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873731584 00000100:00100000:1.0:1784045184.380567:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873731584 00000100:00100000:1.0:1784045184.380601:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045184.380607:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005eed530f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873731584:12345-0@lo:38: 00000100:00080000:0.0:1784045184.381086:0:6523:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784045184.382684:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005eed530f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873731584:12345-0@lo:38: Request processed in 2069us (2264us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784045184.382700:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045184.386147:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784045184.386163:0:3622:0:(import.c:65:import_set_state_nolock()) 000000002a7390d9 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784045184.386172:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784045184.386176:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000523c27e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1870706873731584:0@lo:38: 00000100:00100000:0.0:1784045184.388627:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006753aa60 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:6523:1870706873731712:0@lo:502: 00000100:00100000:0.0:1784045184.388727:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045184.388795:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f81fd6b6 going to sleep for 11 seconds 00000100:00100000:2.0:1784045184.388856:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873731712 00000100:00100000:2.0:1784045184.388864:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873731712 00000100:00100000:2.0:1784045184.388915:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784045184.388922:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009af0870b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6523:x1870706873731712:12345-0@lo:502: 00000100:00100000:2.0:1784045184.389156:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009af0870b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6523:x1870706873731712:12345-0@lo:502: Request processed in 235us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045184.389164:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784045184.389249:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006753aa60 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:6523:1870706873731712:0@lo:502: 00000040:00080000:0.0:1784045184.389276:0:6523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1784045184.389582:0:6473:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1784045184.389604:0:6473:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784045184.389621:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c189 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.389632:0:6473:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c189 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784045184.389681:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784045184.389684:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784045184.389686:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045184.389692:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045184.389693:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045184.389694:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045184.389695:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784045184.389697:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784045184.389698:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784045184.389699:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784045184.389701:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045184.389702:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784045184.389706:0:6473:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1784045184.389709:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784045184.389710:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784045184.389711:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045184.389712:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045184.389713:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045184.389714:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045184.389715:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784045184.389716:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784045184.389716:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784045184.389717:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784045184.389718:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045184.389719:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784045184.389743:0:6473:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784045184.389753:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000076bbfb61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873731840:0@lo:253: 00000100:00100000:2.0:1784045184.389789:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045184.389847:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set 00000000104f9bc8 going to sleep for 11 seconds 00000100:00100000:0.0:1784045184.390668:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873731840 00000100:00100000:0.0:1784045184.390676:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873731840 00000100:00100000:0.0:1784045184.390775:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784045184.390783:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000238517f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6473:x1870706873731840:12345-0@lo:253: 20000000:01000000:0.0:1784045184.390815:0:6489:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784045184.390833:0:6489:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784045184.397253:0:6489:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784045184.397275:0:6489:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1784045184.397695:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000238517f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6473:x1870706873731840:12345-0@lo:253: Request processed in 6909us (7902us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045184.397710:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 20000000:01000000:2.0:1784045184.397809:0:6512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784045184.397815:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784045184.397836:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.397854:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003caf6fef/0x5475624df454c16d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c166 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.397862:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.397903:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003caf6fef/0x5475624df454c16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c166 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.397930:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003caf6fef/0x5475624df454c16d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c166 expref: 11 pid: 6490 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045184.397946:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eb37def8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873731968:0@lo:104: 00000100:00100000:2.0:1784045184.397986:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045184.398136:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000076bbfb61 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:6473:1870706873731840:0@lo:253: 10000000:01000000:3.0:1784045184.398151:0:6473:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784045184.398154:0:6473:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784045184.398157:0:6473:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784045184.398158:0:6473:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045184.398159:0:6473:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045184.398161:0:6473:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045184.398162:0:6473:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045184.398163:0:6473:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784045184.398165:0:6473:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784045184.398167:0:6473:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784045184.398168:0:6473:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784045184.398169:0:6473:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045184.398171:0:6473:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784045184.398186:0:6473:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1784045184.399125:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b4485fe going to sleep for 11 seconds 00000100:00100000:1.0:1784045184.399300:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873731968 00000100:00100000:1.0:1784045184.399308:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873731968 00000100:00100000:1.0:1784045184.399364:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045184.399373:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fdeac0f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6512:x1870706873731968:12345-0@lo:104: 00010000:00010000:1.0:1784045184.399388:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c16d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045184.399491:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045184.399496:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fdeac0f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6512:x1870706873731968:12345-0@lo:104: Request processed in 126us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045184.399504:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1784045184.400659:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045184.400670:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c16d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.400681:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000773255c2 already unused, calling callback (0000000087fd0cac) 10000000:00010000:2.0:1784045184.400685:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c16d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.400695:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c16d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045184.400702:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c16d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045184.400707:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784045184.400768:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c16d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.400774:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045184.400792:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c16d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.400798:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c16d expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.400835:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045184.400837:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045184.400838:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045184.400877:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eb37def8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873731968:0@lo:104: 00010000:00010000:2.0:1784045184.400900:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045184.401045:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c57a38d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873732096:0@lo:103: 00000100:00100000:1.0:1784045184.401109:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045184.401343:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873732096 00000100:00100000:2.0:1784045184.401351:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873732096 00010000:00010000:2.0:1784045184.401379:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003caf6fef/0x5475624df454c16d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c166 expref: 12 pid: 6490 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045184.401434:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045184.401482:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022db51be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:3624:x1870706873732096:12345-0@lo:103: 00010000:00010000:2.0:1784045184.401498:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045184.401503:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003caf6fef/0x5475624df454c16d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c166 expref: 12 pid: 6490 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.401513:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003caf6fef/0x5475624df454c16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c166 expref: 12 pid: 6490 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.401528:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003caf6fef/0x5475624df454c16d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c166 expref: 12 pid: 6490 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.401542:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.401551:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784045184.401573:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003759372s 00010000:00010000:2.0:1784045184.401577:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.401584:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.401590:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.401595:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.401601:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b70ef872 already unused, calling callback (0000000010207b6b) 00010000:00010000:2.0:1784045184.401604:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.401611:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.401625:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.401633:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045184.401679:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022db51be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+11:3624:x1870706873732096:12345-0@lo:103: Request processed in 239us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045184.401687:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045184.401717:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c57a38d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873732096:0@lo:103: 00010000:00010000:2.0:1784045184.401745:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.401757:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045184.401762:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b70ef872/0x5475624df454c19e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1784045184.411858:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1784045184.412033:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1784045184.412265:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1784045184.412433:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1784045184.412669:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1784045184.412857:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1784045184.414381:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1784045184.414835:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1784045184.415063:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1784045184.415211:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1784045184.415384:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1784045184.415770:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1784045184.417949:0:6473:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1784045184.434701:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1784045184.436034:0:6529:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1784045184.439826:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784045184.439952:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784045184.440395:0:6473:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784045184.440403:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784045184.440535:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784045184.441504:0:6473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784045184.442851:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1784045184.447110:0:6528:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1784045184.447120:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:0.0:1784045184.448202:0:6529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784045184.448285:0:6529:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784045184.448290:0:6529:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1784045184.448988:0:6473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784045184.449124:0:6473:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1784045184.449713:0:6473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784045184.450075:0:6473:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1784045184.451267:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1784045184.451382:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1784045184.451888:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1784045184.452066:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1784045184.452181:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1784045184.452320:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1784045184.452833:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1784045184.452982:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1784045184.453180:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1784045184.453317:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1784045184.453838:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1784045184.453977:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1784045184.454205:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1784045184.454340:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1784045184.454846:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1784045184.455083:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1784045184.455383:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1784045184.455925:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1784045184.457775:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1784045184.457972:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1784045184.458192:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1784045184.458365:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1784045184.458904:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1784045184.459118:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1784045184.459259:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1784045184.459887:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1784045184.460062:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1784045184.460195:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1784045184.460348:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1784045184.460587:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1784045184.460925:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1784045184.461069:0:6473:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1784045184.461278:0:6473:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1784045184.464438:0:6473:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784045184.464512:0:6473:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb20481953988 00100000:10000000:3.0:1784045184.464522:0:6473:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1784045184.465158:0:6473:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784045184.465178:0:6473:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784045184.465197:0:6473:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1784045184.465215:0:6473:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1784045184.467116:0:6473:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045184.467304:0:6473:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1784045184.988788:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045186.003795:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045187.027659:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045188.052571:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045189.076633:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784045189.176877:0:6774:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1784045189.784266:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784045189.784276:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784045189.784280:0:36:0:(import.c:65:import_set_state_nolock()) 000000002a7390d9 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784045189.784293:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000002a7390d9 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045189.784322:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000669bdb19 x1870706873732352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:1.0:1784045189.784432:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784045189.784437:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939c9775c000 from 3 10000000:01000000:1.0:1784045189.784469:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784045189.784502:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045189.784512:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045189.784524:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045189.784545:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001fac8b17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873732480:0@lo:101: 00000100:00100000:1.0:1784045189.784623:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045189.784670:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 000000004dd1bd68 going to sleep for 11 seconds 00000100:00100000:2.0:1784045189.784881:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000669bdb19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1870706873732352:0@lo:38: 00000100:00100000:2.0:1784045189.784916:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.785508:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006753aa60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873732224:0@lo:400: 00000100:00100000:0.0:1784045189.785547:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.785593:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873732480 00000100:00100000:0.0:1784045189.785602:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873732480 00000100:00100000:0.0:1784045189.785641:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873732224 00000100:00100000:0.0:1784045189.785644:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873732224 00000100:00100000:0.0:1784045189.785660:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784045189.785668:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081a9acd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6493:x1870706873732480:12345-0@lo:101: 00010000:00010000:0.0:1784045189.785685:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045189.785716:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d2c30a0/0x5475624df454c1ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c1a5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.785746:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d2c30a0/0x5475624df454c1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c1a5 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.785766:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d2c30a0/0x5475624df454c1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c1a5 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.785777:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d2c30a0, rc 0) 00000100:00100000:0.0:1784045189.785822:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081a9acd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+13:6493:x1870706873732480:12345-0@lo:101: Request processed in 154us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.785829:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784045189.785859:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784045189.785865:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f844f1b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:3625:x1870706873732224:12345-0@lo:400: 00000100:00100000:0.0:1784045189.785897:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f844f1b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:3625:x1870706873732224:12345-0@lo:400: Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045189.785903:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784045189.785943:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006753aa60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873732224:0@lo:400: 00000100:00100000:1.0:1784045189.786081:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873732352 00000100:00100000:1.0:1784045189.786086:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873732352 00000100:00100000:1.0:1784045189.786111:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045189.786115:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c57a38d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1870706873732352:12345-0@lo:38: 00010000:00080000:1.0:1784045189.786137:0:6498:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:1.0:1784045189.786173:0:6498:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5475624df454c1b3 00000004:00100000:1.0:1784045189.786216:0:6498:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1784045189.786906:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001fac8b17 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873732480:0@lo:101: 00010000:00010000:0.0:1784045189.786928:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c1ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045189.786941:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c1ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784045189.787477:0:6498:0:(import.c:65:import_set_state_nolock()) 0000000023c21578 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784045189.787558:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c57a38d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1870706873732352:12345-0@lo:38: Request processed in 1440us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045189.787567:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784045189.787685:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000669bdb19 x1870706873732352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784045189.787711:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784045189.787720:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784045189.787726:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784045189.787729:0:3622:0:(import.c:65:import_set_state_nolock()) 000000002a7390d9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784045189.787735:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000669bdb19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1870706873732352:0@lo:38: 00000100:00100000:0.0:1784045189.787890:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006753aa60 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873732608:0@lo:256: 00000100:00100000:0.0:1784045189.787935:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045189.788054:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 000000006c4bc000 going to sleep for 11 seconds 00000100:00100000:1.0:1784045189.788106:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873732608 00000100:00100000:1.0:1784045189.788114:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873732608 00000100:00100000:1.0:1784045189.788156:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784045189.788165:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b915558 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6493:x1870706873732608:12345-0@lo:256: 20000000:01000000:1.0:1784045189.788187:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784045189.788212:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784045189.788216:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1784045189.788858:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b915558 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:6493:x1870706873732608:12345-0@lo:256: Request processed in 692us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045189.788867:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784045189.791546:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006753aa60 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873732608:0@lo:256: 10000000:01000000:2.0:1784045189.791644:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784045189.791656:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c1ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045189.791668:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c1ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1784045190.077921:0:6826:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045190.078431:0:6826:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784045190.101871:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045191.123941:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045192.149033:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784045192.793770:0:6928:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045192.793994:0:6928:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784045193.171690:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045194.202680:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045194.903959:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038040781 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873732864:0@lo:400: 00000100:00100000:2.0:1784045194.904052:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045194.904139:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873732864 00000100:00100000:2.0:1784045194.904147:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873732864 00000100:00100000:2.0:1784045194.904205:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045194.904215:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e185390a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873732864:12345-0@lo:400: 00000100:00100000:2.0:1784045194.904284:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e185390a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873732864:12345-0@lo:400: Request processed in 70us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045194.904293:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784045194.904342:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000038040781 x1870706873732864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045194.904357:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038040781 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873732864:0@lo:400: 00000100:00100000:1.0:1784045194.904536:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eb37def8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873732736:0@lo:400: 00000100:00100000:1.0:1784045194.904574:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045194.904794:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873732736 00000100:00100000:2.0:1784045194.904800:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873732736 00000100:00100000:2.0:1784045194.904835:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784045194.904841:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e77d3f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:3626:x1870706873732736:12345-0@lo:400: 00000100:00100000:2.0:1784045194.904886:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e77d3f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:3626:x1870706873732736:12345-0@lo:400: Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045194.904894:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784045194.905093:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eb37def8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873732736:0@lo:400: 00010000:00010000:2.0:1784045195.227816:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045196.248790:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045197.271251:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045198.293302:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045199.317011:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045200.019792:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045200.019823:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038040781 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873732992:0@lo:400: 00000100:00100000:1.0:1784045200.019914:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045200.019976:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045200.019985:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000191b0630 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873733120:0@lo:400: 00000100:00100000:1.0:1784045200.020021:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045200.020053:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873733120 00000100:00100000:1.0:1784045200.020061:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873733120 00000100:00100000:1.0:1784045200.020116:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045200.020126:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bc2935e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873733120:12345-0@lo:400: 00000100:00100000:1.0:1784045200.020183:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bc2935e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873733120:12345-0@lo:400: Request processed in 58us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045200.020191:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784045200.020242:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000191b0630 x1870706873733120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045200.020256:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000191b0630 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873733120:0@lo:400: 00000100:00100000:2.0:1784045200.020394:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873732992 00000100:00100000:2.0:1784045200.020400:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873732992 00000100:00100000:2.0:1784045200.020470:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784045200.020478:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e537675e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:3623:x1870706873732992:12345-0@lo:400: 00000100:00100000:2.0:1784045200.020522:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e537675e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:3623:x1870706873732992:12345-0@lo:400: Request processed in 45us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045200.020528:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784045200.020689:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038040781 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873732992:0@lo:400: 00010000:00010000:2.0:1784045200.343518:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045201.365188:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045202.387614:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045203.411636:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784045203.419675:0:7426:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784045203.419692:0:7426:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1784045203.419694:0:7426:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1784045203.420273:0:7426:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000039c45b3 00000020:01000004:1.0:1784045203.420296:0:7426:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1784045203.420379:0:7426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784045203.420395:0:7426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000060c400f8) 00000020:00000080:1.0:1784045203.420416:0:7426:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784045203.496224:0:7426:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1784045203.496327:0:7426:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1784045203.524909:0:7426:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784045203.525338:0:7426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1784045203.525350:0:7426:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784045203.525363:0:7426:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5475624df454c1c1 00000020:01000004:1.0:1784045203.525370:0:7426:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1784045203.525392:0:7426:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.144@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784045203.525395:0:7426:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784045203.525401:0:7426:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1784045203.525431:0:7426:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1784045203.525435:0:7426:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1784045203.559608:0:7426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784045203.559657:0:7426:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.144@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1784045203.559661:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784045203.559663:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784045203.559665:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045203.559666:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045203.559667:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045203.559669:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045203.559670:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045203.559671:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784045203.559673:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784045203.559674:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045203.559675:0:7426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784045203.559679:0:7426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1784045203.559682:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784045203.559683:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784045203.559683:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045203.559685:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045203.559686:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045203.559687:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045203.559688:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045203.559689:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784045203.559690:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784045203.559691:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045203.559692:0:7426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784045203.559722:0:7426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1784045203.559742:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000356355e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873733248:0@lo:253: 00000100:00100000:0.0:1784045203.559818:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045203.559913:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 0000000005de7325 going to sleep for 11 seconds 00000100:00100000:2.0:1784045203.559961:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873733248 00000100:00100000:2.0:1784045203.559969:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873733248 00000100:00100000:2.0:1784045203.560021:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045203.560030:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000682c60da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:7426:x1870706873733248:12345-0@lo:253: 20000000:01000000:2.0:1784045203.560329:0:6489:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1784045203.560334:0:6489:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1784045203.560338:0:6489:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1784045203.560342:0:6489:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1784045203.560381:0:6489:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1784045203.560731:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784045203.560859:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1784045203.560877:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784045203.560893:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1784045203.560910:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1784045203.560924:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1784045203.560978:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1784045203.560988:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1784045203.561001:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1784045203.561017:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1784045203.561032:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1784045203.561037:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1784045203.561165:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1784045203.561182:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1784045203.561297:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1784045203.561308:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:2.0:1784045203.561323:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1784045203.561328:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784045203.561341:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1784045203.561346:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:2.0:1784045203.561359:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1784045203.561363:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1784045203.561375:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1784045203.561390:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1784045203.561400:0:6489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1784045203.561960:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1784045203.561975:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1784045203.561991:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1784045203.562011:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1784045203.562029:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1784045203.562035:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1784045203.562062:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1784045203.562086:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1784045203.562092:0:6489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1784045203.562122:0:6489:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1784045203.562129:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1784045203.562708:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1784045203.562934:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1784045203.562956:0:6489:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.144@tcp for mdt 20000000:01000000:1.0:1784045203.562958:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:1.0:1784045203.562973:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1784045203.562979:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784045203.562991:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1784045203.562996:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:1.0:1784045203.563011:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1784045203.563018:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1784045203.563031:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1784045203.563046:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1784045203.563112:0:6489:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1784045203.563120:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1784045203.564343:0:7433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1784045203.564565:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1784045203.564588:0:6489:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.203.144@tcp for mdt 20000000:01000000:3.0:1784045203.564591:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:3.0:1784045203.564607:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1784045203.564627:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784045203.564654:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1784045203.564661:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:3.0:1784045203.564688:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1784045203.564697:0:6489:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1784045203.564712:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1784045203.564730:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1784045203.564752:0:6489:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784045203.564756:0:6489:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784045203.564759:0:6489:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784045203.564808:0:6489:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1784045203.564811:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784045203.565133:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1784045203.565153:0:7434:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1784045203.565166:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1784045203.565322:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1784045203.565422:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1784045203.570685:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1784045203.571020:0:6489:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784045203.571025:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784045203.574796:0:7435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1784045203.574847:0:7435:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1784045203.574863:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1784045203.575060:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1784045203.575087:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1784045203.575100:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1784045203.575109:0:6489:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784045203.575112:0:6489:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784045203.575404:0:7436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1784045203.575422:0:7436:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1784045203.575436:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1784045203.575991:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1784045203.576014:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1784045203.576037:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1784045203.576050:0:6489:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1784045203.576052:0:6489:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1784045203.576057:0:6489:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1784045203.576062:0:6489:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1784045203.576683:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1784045203.576807:0:6489:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1784045203.587404:0:6489:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784045203.587430:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.587484:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a354933f/0x5475624df454c0fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c0f6 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.587492:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e918a6c5/0x5475624df454c119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c112 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.587497:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000038664a16/0x5475624df454c189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c182 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.587503:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.587542:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000038664a16/0x5475624df454c189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c182 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.587566:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000038664a16/0x5475624df454c189 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c182 expref: 12 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045203.587582:0:6489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3243bc3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6489:1870706873733376:0@lo:104: 00000100:00100000:0.0:1784045203.587654:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784045203.587706:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e918a6c5/0x5475624df454c119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c112 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.587715:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e918a6c5/0x5475624df454c119 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c112 expref: 12 pid: 6489 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045203.587721:0:6489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6489:1870706873733504:0@lo:104: 00000100:00100000:0.0:1784045203.587739:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045203.587764:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873733376 00000100:00100000:0.0:1784045203.587770:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873733376 00000100:00100000:0.0:1784045203.587805:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873733504 00000100:00100000:0.0:1784045203.587807:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873733504 00000100:00100000:0.0:1784045203.587817:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045203.587823:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a4913a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6489:x1870706873733376:12345-0@lo:104: 00010000:00010000:0.0:1784045203.587834:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c189 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.587882:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784045203.587886:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a4913a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6489:x1870706873733376:12345-0@lo:104: Request processed in 64us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045203.587892:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045203.587906:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045203.587911:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ba6e24 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6489:x1870706873733504:12345-0@lo:104: 00010000:00010000:0.0:1784045203.587921:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c119 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.587947:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784045203.587951:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ba6e24 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6489:x1870706873733504:12345-0@lo:104: Request processed in 41us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045203.587956:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1784045203.587976:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a354933f/0x5475624df454c0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c0f6 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.587983:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a354933f/0x5475624df454c0fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c0f6 expref: 12 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045203.587991:0:6489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ee142448 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6489:1870706873733632:0@lo:104: 00000100:00100000:0.0:1784045203.588007:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045203.588020:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873733632 00000100:00100000:0.0:1784045203.588022:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873733632 00000100:00100000:0.0:1784045203.588034:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045203.588038:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc0c6ebe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6489:x1870706873733632:12345-0@lo:104: 00010000:00010000:0.0:1784045203.588043:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c0fd expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.588062:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784045203.588065:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc0c6ebe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6489:x1870706873733632:12345-0@lo:104: Request processed in 28us (59us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045203.588070:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045203.588082:0:6489:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aa18b063 going to sleep for 11 seconds 00000100:00100000:0.0:1784045203.588100:0:6489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3243bc3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6489:1870706873733376:0@lo:104: 00000100:00100000:0.0:1784045203.588115:0:6489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6489:1870706873733504:0@lo:104: 00000100:00100000:0.0:1784045203.588120:0:6489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ee142448 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6489:1870706873733632:0@lo:104: 00010000:00010000:0.0:1784045203.588140:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588514:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784045203.588520:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c189 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588528:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cd30cffc already unused, calling callback (0000000087fd0cac) 10000000:00010000:2.0:1784045203.588532:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c189 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588540:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c189 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045203.588546:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c189 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045203.588551:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784045203.588588:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c189 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588594:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045203.588623:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c189 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588629:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 00000000cd30cffc/0x5475624df454c182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c189 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588642:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784045203.588643:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c119 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588649:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f048afce already unused, calling callback (0000000087fd0cac) 10000000:00010000:2.0:1784045203.588651:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c119 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588657:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c119 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045203.588662:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c119 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045203.588667:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784045203.588676:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c119 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588682:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045203.588692:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c119 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588706:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 00000000f048afce/0x5475624df454c112 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c119 expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588716:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045203.588717:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c0fd expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588721:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f927ed05 already unused, calling callback (0000000087fd0cac) 10000000:00010000:2.0:1784045203.588723:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c0fd expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588729:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c0fd expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045203.588733:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c0fd expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045203.588738:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784045203.588748:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c0fd expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588753:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045203.588757:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c0fd expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588762:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 00000000f927ed05/0x5475624df454c0f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c0fd expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.588780:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045203.588785:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045203.588786:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045203.588793:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045203.588805:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003122cb83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873733760:0@lo:103: 00000100:00100000:2.0:1784045203.588837:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.588964:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000004ceb6e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873734016:0@lo:103: 00000100:00100000:2.0:1784045203.588987:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.589003:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045203.589007:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000047bb1b24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873733888:0@lo:103: 00000100:00100000:2.0:1784045203.589022:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.589042:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873733760 00000100:00100000:2.0:1784045203.589046:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873733760 00010000:00010000:2.0:1784045203.589066:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000038664a16/0x5475624df454c189 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c182 expref: 13 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045203.589079:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873734016 00000100:00100000:2.0:1784045203.589081:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873734016 00010000:00010000:2.0:1784045203.589089:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a354933f/0x5475624df454c0fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c0f6 expref: 14 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045203.589096:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873733888 00000100:00100000:2.0:1784045203.589098:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873733888 00010000:00010000:2.0:1784045203.589104:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e918a6c5/0x5475624df454c119 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c112 expref: 15 pid: 6489 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045203.589113:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784045203.589117:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a5557a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:3625:x1870706873733760:12345-0@lo:103: 00010000:00010000:2.0:1784045203.589127:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045203.589130:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000038664a16/0x5475624df454c189 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c182 expref: 15 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589149:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000038664a16/0x5475624df454c189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c182 expref: 15 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589161:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038664a16/0x5475624df454c189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c182 expref: 15 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589173:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045203.589197:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a5557a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:3625:x1870706873733760:12345-0@lo:103: Request processed in 80us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.589203:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784045203.589215:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045203.589219:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8229711 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+13:3624:x1870706873734016:12345-0@lo:103: 00010000:00010000:2.0:1784045203.589225:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045203.589228:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a354933f/0x5475624df454c0fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c0f6 expref: 13 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589234:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a354933f/0x5475624df454c0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c0f6 expref: 13 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589242:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a354933f/0x5475624df454c0fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c0f6 expref: 13 pid: 6488 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589249:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045203.589266:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8229711 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:3624:x1870706873734016:12345-0@lo:103: Request processed in 47us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.589271:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045203.589279:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045203.589284:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050e6f3ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+11:3624:x1870706873733888:12345-0@lo:103: 00010000:00010000:2.0:1784045203.589294:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045203.589297:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e918a6c5/0x5475624df454c119 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c112 expref: 11 pid: 6489 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589305:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e918a6c5/0x5475624df454c119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c112 expref: 11 pid: 6489 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589313:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e918a6c5/0x5475624df454c119 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c112 expref: 11 pid: 6489 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589322:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589328:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589339:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589345:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589351:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589356:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589361:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dbfda3d5 already unused, calling callback (0000000010207b6b) 00010000:00010000:2.0:1784045203.589364:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589380:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589390:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.589399:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045203.589421:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050e6f3ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+10:3624:x1870706873733888:12345-0@lo:103: Request processed in 138us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.589427:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1784045203.589569:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045203.589649:0:6489:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.589656:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.589661:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dbfda3d5/0x5475624df454c1c8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784045203.589677:0:6489:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1784045203.590222:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003122cb83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873733760:0@lo:103: 00000100:00100000:2.0:1784045203.590250:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000047bb1b24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873733888:0@lo:103: 00000100:00100000:2.0:1784045203.590256:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000004ceb6e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873734016:0@lo:103: 00000100:00100000:0.0:1784045203.591852:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000682c60da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+9:7426:x1870706873733248:12345-0@lo:253: Request processed in 31818us (32028us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045203.591864:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045203.591951:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000356355e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873733248:0@lo:253: 10000000:01000000:2.0:1784045203.591965:0:7426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1784045203.591969:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784045203.591971:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784045203.591972:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045203.591973:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1784045203.591975:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045203.591976:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045203.591977:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784045203.591978:0:7426:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784045203.591980:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045203.591981:0:7426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784045203.591999:0:7426:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000039c45b3 from lustre-MDT0001 10000000:01000000:2.0:1784045203.592030:0:7426:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1784045203.592032:0:7426:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1784045203.592038:0:7426:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff939c901d3380 local copy 10000000:01000000:2.0:1784045203.592055:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784045203.592091:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.592101:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.592108:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045203.592124:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000004ceb6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873734144:0@lo:101: 00000100:00100000:2.0:1784045203.592160:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.592197:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd4b9682 going to sleep for 11 seconds 00000100:00100000:3.0:1784045203.592259:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873734144 00000100:00100000:3.0:1784045203.592283:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873734144 00000100:00100000:3.0:1784045203.592353:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784045203.592362:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc24c0d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+9:7426:x1870706873734144:12345-0@lo:101: 00010000:00010000:3.0:1784045203.592383:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045203.592402:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000769c7492/0x5475624df454c1d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c1cf expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.592477:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000769c7492/0x5475624df454c1d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c1cf expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.592488:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000769c7492/0x5475624df454c1d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c1cf expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.592497:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000769c7492, rc 0) 00000100:00100000:3.0:1784045203.592576:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc24c0d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+10:7426:x1870706873734144:12345-0@lo:101: Request processed in 214us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045203.592584:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784045203.593085:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000004ceb6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873734144:0@lo:101: 00010000:00010000:0.0:1784045203.593108:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5475624df454c1d6 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.593118:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5475624df454c1d6 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045203.593220:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ee142448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873734272:0@lo:501: 00000100:00100000:0.0:1784045203.593262:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045203.593303:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c8ddf01e going to sleep for 11 seconds 00000100:00100000:2.0:1784045203.593350:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873734272 00000100:00100000:2.0:1784045203.593356:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873734272 00000100:00100000:2.0:1784045203.593404:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784045203.593411:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbae4e0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+10:7426:x1870706873734272:12345-0@lo:501: 00000100:00100000:2.0:1784045203.593582:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbae4e0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+10:7426:x1870706873734272:12345-0@lo:501: Request processed in 170us (318us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045203.593590:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784045203.593840:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ee142448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873734272:0@lo:501: 10000000:01000000:0.0:1784045203.593866:0:7426:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784045203.593886:0:7426:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784045203.593891:0:7426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5475624df454c1d6 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.593900:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5475624df454c1d6 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.593905:0:7426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5475624df454c1d6 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.593927:0:7426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784045203.593953:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff939c9157c000 10000000:01000000:0.0:1784045203.593958:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784045203.593964:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff939c901d3380 00010000:00010000:2.0:1784045203.593967:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:0.0:1784045203.593968:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1784045203.593978:0:7426:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff939c901d3380 from 1 00010000:00010000:2.0:1784045203.593981:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5475624df454c1d6 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045203.593982:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784045203.593996:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b70ef872 already unused, calling callback (0000000087fd0cac) 10000000:00010000:2.0:1784045203.594003:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5475624df454c1d6 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.594011:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000d4f70f57/0x5475624df454c1dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.594014:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5475624df454c1d6 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.594045:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000d4f70f57/0x5475624df454c1dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.594054:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000d4f70f57/0x5475624df454c1dd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045203.594072:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5475624df454c1d6 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045203.594082:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1784045203.594084:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ee142448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873734400:0@lo:101: 00010000:00010000:2.0:1784045203.594123:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5475624df454c1d6 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045203.594140:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045203.594144:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045203.594183:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5475624df454c1d6 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045203.594192:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aa18b063 going to sleep for 11 seconds 00010000:00010000:2.0:1784045203.594193:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 00000000b70ef872/0x5475624df454c1cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5475624df454c1d6 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.594221:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045203.594223:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045203.594225:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045203.594242:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000047bb1b24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873734528:0@lo:103: 00000100:00100000:2.0:1784045203.594314:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045203.594316:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873734400 00000100:00100000:1.0:1784045203.594325:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873734400 00000100:00100000:1.0:1784045203.594378:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784045203.594385:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bba2849f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+10:7426:x1870706873734400:12345-0@lo:101: 00010000:00010000:1.0:1784045203.594396:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045203.594411:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009a01470e/0x5475624df454c1e4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c1dd expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.594433:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009a01470e/0x5475624df454c1e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c1dd expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.594482:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009a01470e/0x5475624df454c1e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c1dd expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.594492:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009a01470e, rc 0) 00000100:00100000:1.0:1784045203.594548:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bba2849f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+11:7426:x1870706873734400:12345-0@lo:101: Request processed in 164us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045203.594558:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784045203.594635:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ee142448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873734400:0@lo:101: 00010000:00010000:2.0:1784045203.594654:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000d4f70f57/0x5475624df454c1dd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c1e4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.594663:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000d4f70f57/0x5475624df454c1dd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c1e4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045203.594685:0:7426:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784045203.594694:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000d4f70f57/0x5475624df454c1dd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c1e4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.594712:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000d4f70f57/0x5475624df454c1dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c1e4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045203.594723:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff939c9157c000 10000000:01000000:2.0:1784045203.594729:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784045203.594735:0:7426:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff939c9157c000 from 1 10000000:01000000:2.0:1784045203.594738:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784045203.594759:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 000000003caf6fef/0x5475624df454c1eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.594767:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 000000003caf6fef/0x5475624df454c1eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.594774:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 000000003caf6fef/0x5475624df454c1eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045203.594788:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000440370b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873734656:0@lo:101: 00000100:00100000:2.0:1784045203.594824:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.594852:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 0000000096a36e33 going to sleep for 11 seconds 00000100:00100000:2.0:1784045203.594888:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873734656 00000100:00100000:2.0:1784045203.594895:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873734656 00000100:00100000:0.0:1784045203.594902:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873734528 00000100:00100000:0.0:1784045203.594910:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873734528 00000100:00100000:2.0:1784045203.594947:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784045203.594970:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784045203.594980:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003122cb83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:3625:x1870706873734528:12345-0@lo:103: 00000100:00100000:2.0:1784045203.594987:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8265063 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:7426:x1870706873734656:12345-0@lo:101: 00010000:00010000:0.0:1784045203.594993:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045203.595001:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045203.595014:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000769c7492/0x5475624df454c1d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c1cf expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.595016:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a69251b2/0x5475624df454c1f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c1eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.595059:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045203.595062:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a69251b2/0x5475624df454c1f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c1eb expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.595086:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a69251b2/0x5475624df454c1f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c1eb expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.595094:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a69251b2, rc 0) 00000100:00100000:0.0:1784045203.595119:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003122cb83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:3625:x1870706873734528:12345-0@lo:103: Request processed in 137us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045203.595128:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045203.595132:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000047bb1b24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873734528:0@lo:103: 00000100:00100000:2.0:1784045203.595214:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8265063 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+11:7426:x1870706873734656:12345-0@lo:101: Request processed in 253us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.595220:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784045203.595274:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000440370b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873734656:0@lo:101: 00010000:00010000:0.0:1784045203.595292:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 000000003caf6fef/0x5475624df454c1eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.595302:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 000000003caf6fef/0x5475624df454c1eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045203.595318:0:7426:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784045203.595958:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 000000003caf6fef/0x5475624df454c1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.595967:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 000000003caf6fef/0x5475624df454c1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045203.595976:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1784045203.595984:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784045203.596002:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff939c9157c000 10000000:01000000:0.0:1784045203.596006:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784045203.596009:0:7426:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1784045203.596011:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784045203.596043:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000329e4982/0x5475624df454c1f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.596051:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000329e4982/0x5475624df454c1f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.596059:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000329e4982/0x5475624df454c1f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045203.596079:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873734784:0@lo:101: 00000100:00100000:0.0:1784045203.596141:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045203.596204:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aa18b063 going to sleep for 11 seconds 00000100:00100000:1.0:1784045203.596262:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873734784 00000100:00100000:1.0:1784045203.596269:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873734784 00000100:00100000:1.0:1784045203.596314:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784045203.596322:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f57190d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+11:7426:x1870706873734784:12345-0@lo:101: 00010000:00010000:1.0:1784045203.596333:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045203.596345:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000007c01812/0x5475624df454c200 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c1f9 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.596375:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000007c01812/0x5475624df454c200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c1f9 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.596383:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000007c01812/0x5475624df454c200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c1f9 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.596390:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000007c01812, rc 0) 00000100:00100000:1.0:1784045203.596536:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f57190d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:7426:x1870706873734784:12345-0@lo:101: Request processed in 215us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045203.596542:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784045203.596699:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873734784:0@lo:101: 00010000:00010000:0.0:1784045203.596816:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000329e4982/0x5475624df454c1f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c200 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.596825:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000329e4982/0x5475624df454c1f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c200 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045203.596928:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873734912:0@lo:501: 00000100:00100000:0.0:1784045203.596975:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045203.598879:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aa18b063 going to sleep for 11 seconds 00000100:00100000:2.0:1784045203.602819:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873734912 00000100:00100000:2.0:1784045203.602839:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873734912 00000100:00100000:2.0:1784045203.606520:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784045203.606536:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002244263 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:7426:x1870706873734912:12345-0@lo:501: 00000100:00100000:2.0:1784045203.606813:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002244263 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:7426:x1870706873734912:12345-0@lo:501: Request processed in 280us (9838us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.606822:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784045203.606891:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873734912:0@lo:501: 00000100:00100000:0.0:1784045203.606992:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873735040:0@lo:503: 00000100:00100000:0.0:1784045203.610348:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045203.610490:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aa18b063 going to sleep for 11 seconds 00000100:00100000:2.0:1784045203.610598:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873735040 00000100:00100000:2.0:1784045203.610673:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873735040 00000100:00100000:3.0:1784045203.610877:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784045203.610892:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003deb1b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:7426:x1870706873735040:12345-0@lo:503: 00000100:00100000:3.0:1784045203.614315:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003deb1b31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:7426:x1870706873735040:12345-0@lo:503: Request processed in 3415us (3962us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045203.614334:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784045203.615339:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873735040:0@lo:503: 00000040:00080000:0.0:1784045203.615734:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784045203.615851:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873735168:0@lo:502: 00000100:00100000:0.0:1784045203.615926:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045203.615976:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 000000008ca33039 going to sleep for 11 seconds 00000100:00100000:2.0:1784045203.616701:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873735168 00000100:00100000:2.0:1784045203.616711:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873735168 00000100:00100000:2.0:1784045203.616765:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784045203.616774:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1df07c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:7426:x1870706873735168:12345-0@lo:502: 00000100:00100000:2.0:1784045203.616968:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1df07c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:7426:x1870706873735168:12345-0@lo:502: Request processed in 195us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.616976:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784045203.626361:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873735168:0@lo:502: 00000040:00080000:1.0:1784045203.626851:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784045203.626895:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1784045203.626912:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1784045203.626925:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1784045203.626959:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1784045203.626975:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1784045203.626988:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1784045203.627001:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1784045203.627012:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1784045203.627025:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1784045203.627038:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1784045203.627050:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1784045203.627061:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1784045203.627073:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1784045203.627085:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1784045203.627097:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1784045203.627108:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1784045203.627120:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1784045203.627132:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1784045203.627144:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1784045203.627175:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1784045203.627188:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1784045203.627590:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1784045203.627669:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fcffb200 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873735296:0@lo:502: 00000100:00100000:1.0:1784045203.628021:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045203.628103:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c9b2be1e going to sleep for 11 seconds 00000100:00100000:3.0:1784045203.628310:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873735296 00000100:00100000:3.0:1784045203.628319:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873735296 00000100:00100000:3.0:1784045203.628798:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784045203.628810:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fae005da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:7426:x1870706873735296:12345-0@lo:502: 00000100:00100000:3.0:1784045203.629002:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fae005da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:7426:x1870706873735296:12345-0@lo:502: Request processed in 195us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045203.629011:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784045203.629798:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fcffb200 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873735296:0@lo:502: 00000040:00080000:2.0:1784045203.629928:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1784045203.629958:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1784045203.631642:0:7438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045203.631659:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045203.631661:0:7438:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1784045203.631672:0:7438:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1784045203.631675:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045203.631689:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000f8f5a343) 00000020:00000080:2.0:1784045203.631765:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1784045203.631773:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784045203.631866:0:7438:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784045203.631873:0:7438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5475624df454c20e 00000020:00000080:2.0:1784045203.632102:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1784045203.632107:0:7438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045203.632111:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045203.632112:0:7438:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1784045203.632115:0:7438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045203.632118:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045203.632120:0:7438:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1784045203.632123:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045203.632129:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000cbdb76a9) 00000020:00000080:2.0:1784045203.632139:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1784045203.632142:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784045203.632143:0:7438:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1784045203.632146:0:7438:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1784045203.632151:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784045203.632220:0:7438:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000039c45b3 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1784045203.632234:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000003590ddc7) 00000020:00000080:2.0:1784045203.632243:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1784045203.632326:0:7438:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784045203.632332:0:7438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454c223 00000020:00000080:2.0:1784045203.632440:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1784045203.634252:0:7438:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784045203.634267:0:7438:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5475624df454c22a 00080000:01000000:2.0:1784045203.634291:0:7438:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784045203.634296:0:7438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5475624df454c231 00080000:10000000:3.0:1784045203.637354:0:7438:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1784045203.637652:0:7438:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1784045203.762573:0:7438:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1784045203.762854:0:7438:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1784045203.765116:0:7438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1784045203.765492:0:7438:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784045203.788046:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1784045203.788061:0:7438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045203.788074:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045203.788076:0:7438:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1784045203.788081:0:7438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045203.788087:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045203.788088:0:7438:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1784045203.788091:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784045203.788096:0:7438:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:00000080:3.0:1784045203.788122:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784045203.788136:0:7438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000babaa49b) 00000020:00000080:3.0:1784045203.788156:0:7438:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1784045203.788161:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784045203.788235:0:7438:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1784045203.788240:0:7438:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784045203.788248:0:7438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5475624df454c23f 00010000:00080000:3.0:1784045203.788278:0:7438:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000000270e72@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1784045203.791987:0:7438:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1784045203.799753:0:7438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1784045203.799767:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784045203.799798:0:7438:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784045203.799825:0:7438:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454c246 00000100:00080000:3.0:1784045203.799834:0:7438:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784045203.799839:0:7438:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000000270e72 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045203.799868:0:7438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d3df054f x1870706873735424/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045203.799888:0:7438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1784045203.799940:0:7438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045203.799945:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045203.799947:0:7438:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1784045203.799949:0:7438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784045203.799951:0:7438:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1784045203.799953:0:7438:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784045203.799960:0:7438:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784045203.799961:0:7438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784045203.799963:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045203.799964:0:7438:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784045203.799966:0:7438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045203.799971:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045203.799972:0:7438:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1784045203.799976:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784045203.800002:0:7438:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784045203.800013:0:7438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045203.800016:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045203.800017:0:7438:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1784045203.800019:0:7438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045203.800021:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045203.800022:0:7438:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784045203.800024:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784045203.800025:0:7438:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784045203.800056:0:7438:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045203.800059:0:7438:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045203.800061:0:7438:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784045203.800063:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1784045203.800163:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d3df054f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873735424:0@lo:38: 00000100:00100000:3.0:1784045203.800238:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1784045203.800655:0:7426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1784045203.800687:0:7426:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784045203.800704:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000329e4982/0x5475624df454c1f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c200 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.800714:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000329e4982/0x5475624df454c1f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c200 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045203.800722:0:7426:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939c9157c000 from 1 10000000:01000000:3.0:1784045203.800738:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784045203.800760:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.800768:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.800777:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045203.800789:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e21d7d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873735680:0@lo:101: 00000100:00100000:3.0:1784045203.801164:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045203.801195:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a715921 going to sleep for 11 seconds 00000100:00100000:3.0:1784045203.801279:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873735424 00000100:00100000:3.0:1784045203.801285:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873735424 00000100:00100000:3.0:1784045203.801312:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045203.801318:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea9c96cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1870706873735424:12345-0@lo:38: 00010000:00080000:3.0:1784045203.801339:0:6501:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:3.0:1784045203.801430:0:6501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454c254 00000004:00100000:3.0:1784045203.801472:0:6501:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1784045203.801478:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1784045203.801547:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000044dbc609 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873735552:0@lo:400: 00000100:00100000:3.0:1784045203.801582:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045203.801737:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873735680 00000100:00100000:3.0:1784045203.801742:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873735680 00000100:00100000:3.0:1784045203.801770:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784045203.801775:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a06732d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+12:7426:x1870706873735680:12345-0@lo:101: 00010000:00010000:3.0:1784045203.801785:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045203.801802:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4f04a76/0x5475624df454c25b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c24d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.801881:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4f04a76/0x5475624df454c25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c24d expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.801892:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4f04a76/0x5475624df454c25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c24d expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.801900:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4f04a76, rc 0) 00000100:00100000:3.0:1784045203.801936:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a06732d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+13:7426:x1870706873735680:12345-0@lo:101: Request processed in 160us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045203.801943:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784045203.802157:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873735552 00000100:00100000:3.0:1784045203.802161:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873735552 00000100:00100000:3.0:1784045203.802321:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784045203.802329:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb490830 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873735552:12345-0@lo:400: 00000100:00100000:3.0:1784045203.802422:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb490830 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873735552:12345-0@lo:400: Request processed in 95us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045203.802426:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784045203.802481:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e21d7d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873735680:0@lo:101: 00010000:00010000:3.0:1784045203.802494:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c25b expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.802503:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c25b expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1784045203.802958:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000044dbc609 x1870706873735552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045203.802971:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000044dbc609 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873735552:0@lo:400: 00000100:00100000:3.0:1784045203.803319:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e21d7d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873735808:0@lo:256: 00000100:00100000:3.0:1784045203.803508:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045203.803583:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 000000005a715921 going to sleep for 11 seconds 00000100:00100000:1.0:1784045203.803650:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873735808 00000100:00100000:1.0:1784045203.803656:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873735808 00000100:00100000:1.0:1784045203.803720:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784045203.803727:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2d1b203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+13:7426:x1870706873735808:12345-0@lo:256: 20000000:01000000:1.0:1784045203.803744:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784045203.803761:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784045203.803764:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1784045203.803907:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2d1b203 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+13:7426:x1870706873735808:12345-0@lo:256: Request processed in 180us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045203.803914:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784045203.804169:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e21d7d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873735808:0@lo:256: 10000000:01000000:0.0:1784045203.811154:0:7426:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784045203.811186:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c25b expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.811199:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c25b expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045203.812146:0:7426:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939c9157c000 from 1 10000000:01000000:3.0:1784045203.812151:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045203.812189:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.812196:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.812205:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045203.812239:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873735936:0@lo:101: 00000100:00100000:3.0:1784045203.812321:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045203.812359:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dcf11ac8 going to sleep for 11 seconds 00000100:00100000:0.0:1784045203.812480:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873735936 00000100:00100000:0.0:1784045203.812487:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873735936 00000100:00100000:0.0:1784045203.812530:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784045203.812538:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000589b8bdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+13:7426:x1870706873735936:12345-0@lo:101: 00010000:00010000:0.0:1784045203.812550:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045203.812560:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dbfda3d5/0x5475624df454c269 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c262 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.812581:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dbfda3d5/0x5475624df454c269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c262 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.812605:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dbfda3d5/0x5475624df454c269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c262 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.812624:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dbfda3d5, rc 0) 00000100:00100000:0.0:1784045203.812667:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000589b8bdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:7426:x1870706873735936:12345-0@lo:101: Request processed in 129us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045203.812674:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784045203.813382:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873735936:0@lo:101: 00010000:00010000:3.0:1784045203.813401:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c269 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.813411:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c269 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045203.813559:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736064:0@lo:501: 00000100:00100000:3.0:1784045203.813599:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045203.813634:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dcf11ac8 going to sleep for 11 seconds 00000100:00100000:1.0:1784045203.813735:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873736064 00000100:00100000:1.0:1784045203.813742:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873736064 00000100:00100000:1.0:1784045203.813771:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784045203.813777:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000077b950 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:7426:x1870706873736064:12345-0@lo:501: 00000100:00100000:1.0:1784045203.813886:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000077b950 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:7426:x1870706873736064:12345-0@lo:501: Request processed in 109us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045203.813899:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784045203.817061:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736064:0@lo:501: 00000100:00100000:3.0:1784045203.817125:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736192:0@lo:503: 00000100:00100000:3.0:1784045203.817200:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045203.817243:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dcf11ac8 going to sleep for 11 seconds 00000100:00100000:0.0:1784045203.817537:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873736192 00000100:00100000:0.0:1784045203.817545:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873736192 00000100:00100000:0.0:1784045203.817594:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784045203.817601:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1467d04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:7426:x1870706873736192:12345-0@lo:503: 00000040:00080000:0.0:1784045203.817660:0:6489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784045203.817714:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1467d04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:7426:x1870706873736192:12345-0@lo:503: Request processed in 113us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045203.817721:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784045203.818536:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736192:0@lo:503: 00000040:00080000:3.0:1784045203.818849:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784045203.820524:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1784045203.820669:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784045203.825190:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1784045203.825430:0:7426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1784045203.825488:0:7426:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045203.825503:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c269 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.825516:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c269 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045203.825559:0:7426:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 00000100:00080000:0.0:1784045203.825561:0:6501:0:(import.c:65:import_set_state_nolock()) 000000003695355e : changing import state from RECOVER to FULL 10000000:01000000:3.0:1784045203.825562:0:7426:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff939c9157c000 10000000:01000000:3.0:1784045203.825565:0:7426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff939c9157c000 10000000:01000000:3.0:1784045203.825569:0:7426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784045203.825573:0:7426:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939c9157c000 from 1 10000000:01000000:3.0:1784045203.825576:0:7426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784045203.825604:0:7426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000ba70f9d2/0x5475624df454c270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.825622:0:7426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000ba70f9d2/0x5475624df454c270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.825636:0:7426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000ba70f9d2/0x5475624df454c270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045203.825656:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736320:0@lo:101: 00000100:00100000:0.0:1784045203.825668:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea9c96cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1870706873735424:12345-0@lo:38: Request processed in 24348us (25429us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045203.825681:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045203.825693:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784045203.825707:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1784045203.825714:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784045203.825719:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784045203.825721:0:3622:0:(import.c:65:import_set_state_nolock()) 0000000000270e72 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784045203.825739:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d3df054f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873735424:0@lo:38: 00000100:00100000:3.0:1784045203.825791:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045203.825855:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873736320 00000100:00100000:1.0:1784045203.825861:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873736320 00000100:00100000:1.0:1784045203.825892:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784045203.825899:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e19a624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:7426:x1870706873736320:12345-0@lo:101: 00010000:00010000:1.0:1784045203.825909:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045203.825920:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a354933f/0x5475624df454c277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c270 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.825950:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a354933f/0x5475624df454c277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c270 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.825960:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a354933f/0x5475624df454c277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c270 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.825968:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a354933f, rc 0) 00000100:00100000:1.0:1784045203.825995:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e19a624 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7426:x1870706873736320:12345-0@lo:101: Request processed in 97us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045203.826001:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784045203.826119:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 0000000055be4ea5 going to sleep for 11 seconds 00000100:00100000:3.0:1784045203.826131:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736320:0@lo:101: 00010000:00010000:3.0:1784045203.826143:0:7426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000ba70f9d2/0x5475624df454c270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c277 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.826150:0:7426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000ba70f9d2/0x5475624df454c270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c277 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045203.826287:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736448:0@lo:501: 00000100:00100000:3.0:1784045203.826313:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045203.826333:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 0000000055be4ea5 going to sleep for 11 seconds 00000100:00100000:1.0:1784045203.826358:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873736448 00000100:00100000:1.0:1784045203.826363:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873736448 00000100:00100000:1.0:1784045203.826396:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784045203.826402:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c74003df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7426:x1870706873736448:12345-0@lo:501: 00000100:00100000:1.0:1784045203.826511:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c74003df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7426:x1870706873736448:12345-0@lo:501: Request processed in 110us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045203.826519:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784045203.826538:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736448:0@lo:501: 00000100:00100000:3.0:1784045203.826563:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736576:0@lo:503: 00000100:00100000:3.0:1784045203.826599:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045203.826778:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873736576 00000100:00100000:1.0:1784045203.826783:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873736576 00000100:00100000:1.0:1784045203.826805:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784045203.826810:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc52b1ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7426:x1870706873736576:12345-0@lo:503: 00000100:00100000:1.0:1784045203.826888:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc52b1ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7426:x1870706873736576:12345-0@lo:503: Request processed in 78us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045203.826894:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784045203.828190:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873736704:0@lo:41: 00000100:00100000:1.0:1784045203.828253:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.828324:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873736704 00000100:00100000:2.0:1784045203.828331:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873736704 00000100:00100000:3.0:1784045203.828341:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 0000000055be4ea5 going to sleep for 11 seconds 00000100:00100000:2.0:1784045203.828367:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045203.828371:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736576:0@lo:503: 00000100:00100000:2.0:1784045203.828374:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000088b12bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1870706873736704:12345-0@lo:41: 00000004:00000024:2.0:1784045203.828403:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000040:00080000:3.0:1784045203.828711:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784045203.828777:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736832:0@lo:502: 00000100:00100000:3.0:1784045203.828837:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045203.828868:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873736832 00000100:00100000:3.0:1784045203.828877:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873736832 00000100:00100000:3.0:1784045203.828914:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784045203.828920:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000907a3e08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7426:x1870706873736832:12345-0@lo:502: 00000100:00100000:3.0:1784045203.829004:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000907a3e08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7426:x1870706873736832:12345-0@lo:502: Request processed in 84us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045203.829011:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784045203.829050:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 0000000055be4ea5 going to sleep for 11 seconds 00000100:00100000:3.0:1784045203.829062:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736832:0@lo:502: 00000100:00100000:2.0:1784045203.829470:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000088b12bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3623:x1870706873736704:12345-0@lo:41: Request processed in 1096us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.829478:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:3.0:1784045203.829542:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1784045203.829571:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1784045203.829587:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1784045203.829599:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1784045203.829622:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1784045203.829637:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1784045203.829649:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000100:00100000:1.0:1784045203.829658:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873736704:0@lo:41: 00000040:00080000:3.0:1784045203.829660:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1784045203.829671:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1784045203.829682:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1784045203.829695:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1784045203.829707:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1784045203.829725:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1784045203.829738:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1784045203.829750:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1784045203.829762:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1784045203.829775:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1784045203.829800:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1784045203.829814:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1784045203.830011:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1784045203.830024:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1784045203.830035:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1784045203.830046:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1784045203.830071:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1784045203.830083:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1784045203.830095:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1784045203.830107:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1784045203.830120:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1784045203.830146:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736960:0@lo:502: 00000100:00100000:3.0:1784045203.830191:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045203.830289:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 0000000055be4ea5 going to sleep for 11 seconds 00000100:00100000:0.0:1784045203.830295:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873736960 00000100:00100000:0.0:1784045203.830301:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873736960 00000100:00100000:0.0:1784045203.830333:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784045203.830339:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3b4c319 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7426:x1870706873736960:12345-0@lo:502: 00000100:00100000:0.0:1784045203.830555:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3b4c319 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7426:x1870706873736960:12345-0@lo:502: Request processed in 216us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045203.830562:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784045203.831356:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873736960:0@lo:502: 00000040:00080000:3.0:1784045203.831433:0:7426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1784045203.831597:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1784045203.832374:0:7444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1784045203.832389:0:7444:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000c47d59aa) 00000020:00000080:3.0:1784045203.832410:0:7444:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1784045203.832715:0:7444:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000039c45b3 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1784045203.832720:0:7444:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000039c45b3 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1784045203.832722:0:7444:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000039c45b3 3 00010000:00080000:3.0:1784045203.832758:0:7444:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009e6c1344@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1784045203.834889:0:7444:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1784045203.834991:0:7444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1784045203.835031:0:7444:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784045203.835043:0:7444:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5475624df454c285 00000100:00080000:3.0:1784045203.835052:0:7444:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784045203.835057:0:7444:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000009e6c1344 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045203.835091:0:7444:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f6c853b0 x1870706873737088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045203.835129:0:7444:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784045203.835645:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1870706873737088:0@lo:38: 00000100:00100000:0.0:1784045203.835725:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045203.835792:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873737088 00000100:00100000:0.0:1784045203.835799:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873737088 00000100:00100000:0.0:1784045203.839966:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045203.839978:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3243bc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873737088:12345-0@lo:38: 00010000:00080000:0.0:1784045203.840008:0:6496:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:0.0:1784045203.840053:0:6496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5475624df454c28c 00000004:00100000:0.0:1784045203.840069:0:6496:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784045203.840099:0:6496:0:(import.c:65:import_set_state_nolock()) 00000000ae474fd9 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1784045203.840146:0:7444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1784045203.840180:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3243bc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1870706873737088:12345-0@lo:38: Request processed in 202us (4456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045203.840188:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784045203.840233:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f6c853b0 x1870706873737088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045203.840244:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784045203.840251:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1784045203.840262:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784045203.840267:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784045203.840269:0:3622:0:(import.c:65:import_set_state_nolock()) 000000009e6c1344 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784045203.840274:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6c853b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1870706873737088:0@lo:38: 00000020:01000000:0.0:1784045203.840303:0:7426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1784045203.840330:0:7426:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784045203.840352:0:7426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000ba70f9d2/0x5475624df454c270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c277 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045203.840363:0:7426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000ba70f9d2/0x5475624df454c270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c277 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784045203.840419:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784045203.840421:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784045203.840423:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045203.840424:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045203.840425:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045203.840426:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045203.840427:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045203.840428:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784045203.840430:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784045203.840431:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045203.840432:0:7426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784045203.840435:0:7426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1784045203.840438:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784045203.840439:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784045203.840440:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045203.840441:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045203.840458:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045203.840459:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045203.840460:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045203.840461:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784045203.840462:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784045203.840464:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045203.840464:0:7426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784045203.840484:0:7426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1784045203.840499:0:7426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873737216:0@lo:253: 00000100:00100000:0.0:1784045203.840641:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045203.840674:0:7426:0:(client.c:2702:ptlrpc_set_wait()) set 0000000011f3c0be going to sleep for 11 seconds 00000100:00100000:3.0:1784045203.840679:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873737216 00000100:00100000:3.0:1784045203.840691:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873737216 00000100:00100000:3.0:1784045203.840730:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784045203.840736:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1f8df61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7426:x1870706873737216:12345-0@lo:253: 20000000:01000000:3.0:1784045203.840754:0:6488:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784045203.840767:0:6488:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:3.0:1784045203.851159:0:7445:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:0.0:1784045203.855633:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1784045203.856180:0:6488:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784045203.856240:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1784045203.856386:0:6512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784045203.856392:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784045203.856410:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.856429:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001d2c30a0/0x5475624df454c1ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c1a5 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.856436:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e4f04a76/0x5475624df454c25b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c24d expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.856503:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.856542:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e4f04a76/0x5475624df454c25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c24d expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.856554:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e4f04a76/0x5475624df454c25b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c24d expref: 15 pid: 6489 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045203.856584:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000047bb1b24 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873737344:0@lo:104: 00000100:00100000:2.0:1784045203.856659:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045203.856708:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001d2c30a0/0x5475624df454c1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c1a5 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045203.856716:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001d2c30a0/0x5475624df454c1ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c1a5 expref: 15 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045203.856723:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b581493a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873737472:0@lo:104: 00000100:00100000:2.0:1784045203.856746:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.856798:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dcb25e9d going to sleep for 11 seconds 00000100:00100000:3.0:1784045203.857009:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873737344 00000100:00100000:3.0:1784045203.857017:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873737344 00000100:00100000:3.0:1784045203.857050:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873737472 00000100:00100000:3.0:1784045203.857059:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873737472 00000100:00100000:3.0:1784045203.857074:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784045203.857081:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a6bc073 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6512:x1870706873737344:12345-0@lo:104: 00010000:00010000:3.0:1784045203.857091:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c25b expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045203.857248:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000047bb1b24 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873737344:0@lo:104: 00010000:00010000:3.0:1784045203.857278:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784045203.857283:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a6bc073 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6512:x1870706873737344:12345-0@lo:104: Request processed in 203us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045203.857290:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784045203.857306:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784045203.857312:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c923399a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6512:x1870706873737472:12345-0@lo:104: 00010000:00010000:3.0:1784045203.857319:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c1ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045203.857391:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b581493a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873737472:0@lo:104: 00010000:00010000:2.0:1784045203.857414:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.857684:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045203.857691:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c25b expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.857698:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000315b1ab5 already unused, calling callback (0000000087fd0cac) 10000000:00010000:1.0:1784045203.857701:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c25b expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.857708:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c25b expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045203.857714:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c25b expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045203.857719:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045203.857756:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c25b expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.857762:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045203.857780:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c25b expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.857800:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 00000000315b1ab5/0x5475624df454c24d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c25b expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.857813:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045203.857816:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c1ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.857821:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068846607 already unused, calling callback (0000000087fd0cac) 10000000:00010000:1.0:1784045203.857834:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c1ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.857841:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c1ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045203.857847:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c1ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045203.857851:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045203.857864:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c1ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.857870:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045203.857885:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c1ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.857891:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c1a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c1ac expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.857904:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045203.857911:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045203.857913:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045203.857926:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e5d8808 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873737600:0@lo:103: 00000100:00100000:1.0:1784045203.857976:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045203.858010:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045203.858019:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000197686f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873737728:0@lo:103: 00000100:00100000:1.0:1784045203.858043:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045203.858072:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873737600 00000100:00100000:1.0:1784045203.858077:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873737600 00010000:00010000:1.0:1784045203.858095:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e4f04a76/0x5475624df454c25b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c24d expref: 16 pid: 6489 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045203.858115:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873737728 00000100:00100000:1.0:1784045203.858118:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873737728 00010000:00010000:1.0:1784045203.858128:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001d2c30a0/0x5475624df454c1ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c1a5 expref: 17 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045203.858139:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784045203.858144:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001019c6b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:3624:x1870706873737600:12345-0@lo:103: 00010000:00010000:1.0:1784045203.858154:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045203.858158:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e4f04a76/0x5475624df454c25b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c24d expref: 17 pid: 6489 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858166:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e4f04a76/0x5475624df454c25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c24d expref: 17 pid: 6489 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858178:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e4f04a76/0x5475624df454c25b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c24d expref: 17 pid: 6489 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858189:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045203.858222:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001019c6b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:3624:x1870706873737600:12345-0@lo:103: Request processed in 78us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045203.858228:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784045203.858248:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045203.858254:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb8ffe5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:3626:x1870706873737728:12345-0@lo:103: 00010000:00010000:1.0:1784045203.858261:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045203.858264:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001d2c30a0/0x5475624df454c1ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c1a5 expref: 15 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858272:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001d2c30a0/0x5475624df454c1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c1a5 expref: 15 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858280:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001d2c30a0/0x5475624df454c1ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c1a5 expref: 15 pid: 6490 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858290:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858298:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784045203.858310:0:6483:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003759372s 00010000:00010000:1.0:1784045203.858314:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858320:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858325:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858339:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858344:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b70ef872 already unused, calling callback (0000000010207b6b) 00010000:00010000:1.0:1784045203.858347:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858353:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858366:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858375:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045203.858408:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb8ffe5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:3626:x1870706873737728:12345-0@lo:103: Request processed in 154us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045203.858414:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045203.858492:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000197686f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873737728:0@lo:103: 00000100:00100000:1.0:1784045203.858510:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e5d8808 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873737600:0@lo:103: 00010000:00010000:1.0:1784045203.858523:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858530:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045203.858536:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b70ef872/0x5475624df454c293 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045203.859300:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1784045203.859311:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c923399a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6512:x1870706873737472:12345-0@lo:104: Request processed in 1998us (2562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045203.859331:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045203.859705:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1f8df61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+13:7426:x1870706873737216:12345-0@lo:253: Request processed in 18962us (19056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045203.859720:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:2.0:1784045203.859919:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045203.861357:0:7426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:7426:1870706873737216:0@lo:253: 10000000:01000000:0.0:1784045203.861377:0:7426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1784045203.861390:0:7426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784045203.861392:0:7426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784045203.861393:0:7426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045203.861394:0:7426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045203.861395:0:7426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045203.861397:0:7426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045203.861398:0:7426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045203.861399:0:7426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784045203.861401:0:7426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784045203.861402:0:7426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045203.861403:0:7426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784045203.861419:0:7426:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784045203.872386:0:7426:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1784045203.872637:0:7426:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1784045203.872849:0:7426:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1784045203.873033:0:7426:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1784045203.873253:0:7426:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1784045203.873418:0:7426:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1784045203.881169:0:7426:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1784045203.881922:0:7426:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1784045203.882143:0:7426:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1784045203.884123:0:7426:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1784045203.884770:0:7426:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1784045203.886063:0:7426:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1784045203.901347:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1784045203.901671:0:7450:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1784045203.901698:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1784045203.901853:0:7450:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b581493a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7450:1870706873737856:0@lo:700: 00000020:00080000:3.0:1784045203.901995:0:7449:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1784045203.902001:0:7449:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1784045203.902566:0:7450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.902671:0:7450:0:(client.c:2702:ptlrpc_set_wait()) set 0000000002f72f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045203.902776:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873737856 00000100:00100000:3.0:1784045203.902788:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873737856 00000100:00100000:3.0:1784045203.902864:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045203.902875:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047bb1b24 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7450:x1870706873737856:12345-0@lo:700: 00000100:00100000:2.0:1784045203.905085:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e3a5557a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1870706873737984:0@lo:1000: 00000100:00100000:2.0:1784045203.905208:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.905258:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ac28d0e7 going to sleep for 11 seconds 00000100:00100000:0.0:1784045203.906398:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873737984 00000040:01000000:3.0:1784045203.906408:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1784045203.906415:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873737984 00000100:00100000:0.0:1784045203.906528:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045203.906539:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8229711 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7451:x1870706873737984:12345-0@lo:1000: 00000100:00100000:0.0:1784045203.906691:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8229711 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7451:x1870706873737984:12345-0@lo:1000: Request processed in 155us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045203.906700:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045203.906763:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e3a5557a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1870706873737984:0@lo:1000: 00000040:01000000:0.0:1784045203.906811:0:7451:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1784045203.906852:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1870706873738112:0@lo:700: 00000100:00100000:0.0:1784045203.906904:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045203.906930:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000011f3c0be going to sleep for 11 seconds 00000040:00080000:3.0:1784045203.907183:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784045203.909322:0:7426:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784045203.910227:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1784045203.910688:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045203.911921:0:7426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 40000000:02000000:3.0:1784045203.913628:0:6503:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:0.0:1784045203.914882:0:7426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784045203.914984:0:7426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1784045203.917690:0:7426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1784045203.917981:0:7426:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:2.0:1784045203.918505:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873738112 00000100:00100000:2.0:1784045203.918527:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873738112 00000100:00100000:2.0:1784045203.918596:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045203.918606:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007376dddf pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7451:x1870706873738112:12345-0@lo:700: 00000100:00100000:2.0:1784045203.918786:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007376dddf pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7451:x1870706873738112:12345-0@lo:700: Request processed in 181us (11881us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.918797:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045203.918859:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1870706873738112:0@lo:700: 00000100:00100000:1.0:1784045203.919022:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e5d8808 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7451:1870706873738240:0@lo:900: 00000100:00100000:1.0:1784045203.919089:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045203.919138:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000af933d1e going to sleep for 11 seconds 00000100:00100000:2.0:1784045203.919209:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873738240 00000100:00100000:2.0:1784045203.919216:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873738240 00000100:00100000:2.0:1784045203.919253:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045203.919389:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000197686f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7451:x1870706873738240:12345-0@lo:900: 00000100:00100000:2.0:1784045203.919492:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000197686f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7451:x1870706873738240:12345-0@lo:900: Request processed in 106us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.919501:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784045203.919518:0:7451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004e5d8808 x1870706873738240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784045219 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045203.919534:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e5d8808 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7451:1870706873738240:0@lo:900: 00000100:00100000:1.0:1784045203.919655:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e5d8808 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1870706873738368:0@lo:1000: 00000100:00100000:1.0:1784045203.920816:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045203.920884:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873738368 00000100:00100000:1.0:1784045203.920887:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000004ba286b8 going to sleep for 11 seconds 00000100:00100000:2.0:1784045203.920896:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873738368 00000100:00100000:2.0:1784045203.920964:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045203.920974:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022db51be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7451:x1870706873738368:12345-0@lo:1000: 00100000:10000000:0.0:1784045203.923193:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000100:00100000:2.0:1784045203.923379:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022db51be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7451:x1870706873738368:12345-0@lo:1000: Request processed in 2401us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.923394:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00100000:10000000:0.0:1784045203.924827:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1784045203.925032:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1784045203.926743:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1784045203.926968:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00000100:00100000:1.0:1784045203.927062:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e5d8808 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1870706873738368:0@lo:1000: 00000004:00080000:1.0:1784045203.927155:0:7451:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000af933d1e with version 0 00000020:00100000:1.0:1784045203.927182:0:7451:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784045203.927201:0:7451:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004e5d8808 x1870706873738624/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784045203.927237:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004e5d8808 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1870706873738624:0@lo:1000: 00000100:00100000:1.0:1784045203.927299:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045203.927336:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000001cddbaa6 going to sleep for 11 seconds 00000100:00100000:3.0:1784045203.928003:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047bb1b24 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7450:x1870706873737856:12345-0@lo:700: Request processed in 25130us (25439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045203.928012:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045203.928593:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873738624 00000100:00100000:2.0:1784045203.928616:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873738624 00000100:00100000:2.0:1784045203.928684:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784045203.928694:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001019c6b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7451:x1870706873738624:12345-0@lo:1000: 00010000:00080000:2.0:1784045203.929122:0:7450:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b581493a x1870706873737856/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784045219 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045203.929141:0:7450:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b581493a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7450:1870706873737856:0@lo:700: 00100000:10000000:0.0:1784045203.929349:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1784045203.929570:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1784045203.929726:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1784045203.929874:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1784045203.930028:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1784045203.930250:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1784045203.930386:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1784045203.930561:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1784045203.930711:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1784045203.930882:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1784045203.931016:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1784045203.931363:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1784045203.931550:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1784045203.931718:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1784045203.932243:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 40000000:02000000:2.0:1784045203.932289:0:7450:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:1.0:1784045203.932814:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1784045203.933056:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1784045203.933198:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1784045203.933787:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1784045203.934083:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1784045203.934179:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1784045203.934301:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1784045203.934810:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1784045203.935011:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1784045203.935156:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1784045203.935289:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1784045203.935597:0:7426:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1784045203.935960:0:7426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1784045203.943584:0:7426:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784045203.943635:0:7426:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb2048179f988 00100000:10000000:1.0:1784045203.943644:0:7426:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1784045203.948397:0:7426:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784045203.948432:0:7426:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784045203.948489:0:7426:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784045203.948521:0:7426:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1784045203.950528:0:7426:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784045203.950709:0:7426:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:3.0:1784045203.971313:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1784045203.971708:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001019c6b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7451:x1870706873738624:12345-0@lo:1000: Request processed in 43011us (44404us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784045203.971722:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1784045203.972136:0:7451:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1784045203.972142:0:7451:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784045203.972159:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004e5d8808 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1870706873738624:0@lo:1000: 00000100:00100000:3.0:1784045203.972435:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d3df054f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1870706873738752:0@lo:1000: 00000100:00100000:3.0:1784045203.972505:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045203.972547:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000055be4ea5 going to sleep for 11 seconds 00000100:00100000:2.0:1784045203.972570:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873738752 00000100:00100000:2.0:1784045203.972577:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873738752 00000100:00100000:2.0:1784045203.972623:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784045203.972631:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a44efb13 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1870706873738752:12345-0@lo:1000: 00000100:00100000:2.0:1784045203.972709:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a44efb13 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7451:x1870706873738752:12345-0@lo:1000: Request processed in 79us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045203.972716:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784045203.972815:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d3df054f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7451:1870706873738752:0@lo:1000: 00000040:00080000:3.0:1784045203.972838:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1784045203.972945:0:7451:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000ae75aca0 with version 1 00000004:00080000:1.0:1784045203.972985:0:7441:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000a47424ad version 1 rpc_version 1 00000020:00100000:1.0:1784045203.973002:0:7441:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784045203.973009:0:7441:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e5780133 x1870706873739008/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784045203.973022:0:7441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e5780133 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7441:1870706873739008:0@lo:1000: 00000100:00100000:1.0:1784045203.973058:0:7441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045203.973074:0:7441:0:(client.c:2702:ptlrpc_set_wait()) set 0000000061154ffa going to sleep for 11 seconds 00000100:00100000:1.0:1784045203.973090:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873739008 00000100:00100000:1.0:1784045203.973093:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873739008 00000100:00100000:1.0:1784045203.973116:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784045203.973121:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bfa9d785 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7441:x1870706873739008:12345-0@lo:1000: 00000040:00080000:3.0:1784045203.975010:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784045203.975088:0:7451:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1784045203.984392:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1784045203.986584:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1784045203.986830:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bfa9d785 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7441:x1870706873739008:12345-0@lo:1000: Request processed in 13705us (13768us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784045203.986852:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1784045203.987002:0:7441:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1784045203.987008:0:7441:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784045203.987027:0:7441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e5780133 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7441:1870706873739008:0@lo:1000: 00000040:00080000:2.0:1784045203.998398:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784045204.004222:0:7450:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1784045204.004234:0:7450:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1784045204.435722:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045205.459551:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045206.484398:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045207.507654:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784045208.113146:0:7696:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784045208.537914:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784045208.954363:0:7748:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784045208.954937:0:7748:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784045209.237486:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000124418f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873739136:0@lo:41: 00000100:00100000:0.0:1784045209.237592:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045209.237686:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873739136 00000100:00100000:0.0:1784045209.237695:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873739136 00000100:00100000:0.0:1784045209.237770:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784045209.237779:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080165f0e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873739136:12345-0@lo:41: 00000004:00000024:0.0:1784045209.237828:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1784045209.237880:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080165f0e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873739136:12345-0@lo:41: Request processed in 103us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045209.237889:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784045209.237942:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000124418f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873739136:0@lo:41: 00000100:00100000:2.0:1784045209.238874:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b581493a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873739264:0@lo:400: 00000100:00100000:2.0:1784045209.238939:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045209.238980:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045209.238986:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000050e6f3ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873739392:0@lo:400: 00000100:00100000:2.0:1784045209.239012:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045209.239048:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873739392 00000100:00100000:2.0:1784045209.239053:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873739392 00000100:00100000:2.0:1784045209.239092:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045209.239098:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000440370b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873739392:12345-0@lo:400: 00000100:00100000:2.0:1784045209.239142:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000440370b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873739392:12345-0@lo:400: Request processed in 44us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045209.239149:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784045209.239198:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000050e6f3ee x1870706873739392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045209.239210:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000050e6f3ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873739392:0@lo:400: 00000100:00100000:0.0:1784045209.241690:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003122cb83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873739520:0@lo:400: 00000100:00100000:0.0:1784045209.241785:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045209.241868:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873739264 00000100:00100000:0.0:1784045209.241877:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873739264 00000100:00100000:0.0:1784045209.241932:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784045209.241942:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000030479da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+13:3623:x1870706873739264:12345-0@lo:400: 00000100:00100000:0.0:1784045209.242009:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000030479da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+13:3623:x1870706873739264:12345-0@lo:400: Request processed in 68us (3070us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045209.242017:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784045209.242055:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873739520 00000100:00100000:0.0:1784045209.242059:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873739520 00000100:00100000:0.0:1784045209.242085:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045209.242090:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000124418f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873739520:12345-0@lo:400: 00000100:00100000:0.0:1784045209.242126:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000124418f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873739520:12345-0@lo:400: Request processed in 36us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045209.242133:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045209.242191:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b581493a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873739264:0@lo:400: 00010000:00080000:0.0:1784045209.242233:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003122cb83 x1870706873739520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045209.242264:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003122cb83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873739520:0@lo:400: 00010000:00010000:3.0:1784045209.558333:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045210.579737:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045211.603653:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784045211.792187:0:7849:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784045211.792701:0:7849:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784045212.628563:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784045212.823853:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784045212.823861:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939c9157c000 from 4 10000000:01000000:3.0:1784045212.823866:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784045212.823904:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 0000000025324eec/0x5475624df454c29a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045212.823916:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 0000000025324eec/0x5475624df454c29a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045212.823926:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 0000000025324eec/0x5475624df454c29a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045212.823961:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d3df054f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873739648:0@lo:101: 00000100:00100000:3.0:1784045212.824022:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045212.824104:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 0000000037099528 going to sleep for 11 seconds 00000100:00100000:0.0:1784045212.825529:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873739648 00000100:00100000:0.0:1784045212.825538:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873739648 00000100:00100000:1.0:1784045212.825691:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784045212.825701:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e89638a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+13:6493:x1870706873739648:12345-0@lo:101: 00010000:00010000:1.0:1784045212.825716:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045212.825732:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038664a16/0x5475624df454c2a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c29a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.825757:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038664a16/0x5475624df454c2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c29a expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.825767:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038664a16/0x5475624df454c2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c29a expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.825776:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038664a16, rc 0) 00000100:00100000:1.0:1784045212.825848:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e89638a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:6493:x1870706873739648:12345-0@lo:101: Request processed in 149us (1826us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045212.825855:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784045212.826052:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d3df054f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873739648:0@lo:101: 00010000:00010000:2.0:1784045212.826071:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 0000000025324eec/0x5475624df454c29a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.826080:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 0000000025324eec/0x5475624df454c29a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c2a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045212.826142:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000050e6f3ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873739776:0@lo:256: 00000100:00100000:2.0:1784045212.826179:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045212.826215:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 000000009f7dce34 going to sleep for 11 seconds 00000100:00100000:0.0:1784045212.826259:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873739776 00000100:00100000:0.0:1784045212.826263:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873739776 00000100:00100000:0.0:1784045212.826297:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784045212.826311:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f45d165e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:6493:x1870706873739776:12345-0@lo:256: 20000000:01000000:0.0:1784045212.826325:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784045212.826340:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784045212.826343:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1784045212.826426:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f45d165e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:6493:x1870706873739776:12345-0@lo:256: Request processed in 116us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045212.826433:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784045212.826595:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000050e6f3ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873739776:0@lo:256: 10000000:01000000:2.0:1784045212.826637:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784045212.826643:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 0000000025324eec/0x5475624df454c29a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.826651:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 0000000025324eec/0x5475624df454c29a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045212.826660:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784045212.826662:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939c9775c000 from 21 10000000:01000000:2.0:1784045212.826665:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784045212.826683:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000d2b296dc/0x5475624df454c2a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.826690:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000d2b296dc/0x5475624df454c2a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.826704:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000d2b296dc/0x5475624df454c2a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045212.826715:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000050e6f3ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873739904:0@lo:101: 00000100:00100000:2.0:1784045212.826741:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045212.826767:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 000000009f7dce34 going to sleep for 11 seconds 00000100:00100000:0.0:1784045212.826807:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873739904 00000100:00100000:0.0:1784045212.826812:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873739904 00000100:00100000:0.0:1784045212.826853:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784045212.826858:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cacc2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:6493:x1870706873739904:12345-0@lo:101: 00010000:00010000:0.0:1784045212.826866:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045212.826877:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b39309f0/0x5475624df454c2af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c2a8 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045212.826892:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b39309f0/0x5475624df454c2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c2a8 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045212.826900:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b39309f0/0x5475624df454c2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c2a8 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045212.826916:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b39309f0, rc 0) 00000100:00100000:0.0:1784045212.826946:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cacc2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873739904:12345-0@lo:101: Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045212.826952:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784045212.826980:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000050e6f3ee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873739904:0@lo:101: 00010000:00010000:0.0:1784045212.826989:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000d2b296dc/0x5475624df454c2a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2af expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045212.826996:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000d2b296dc/0x5475624df454c2a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c2af expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045212.827050:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d87d6476 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873740032:0@lo:501: 00000100:00100000:0.0:1784045212.827073:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.827087:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aaaef0da going to sleep for 11 seconds 00000100:00100000:0.0:1784045212.827097:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873740032 00000100:00100000:0.0:1784045212.827100:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873740032 00000100:00100000:0.0:1784045212.827116:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784045212.827121:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053de3056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873740032:12345-0@lo:501: 00000100:00100000:0.0:1784045212.827226:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053de3056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873740032:12345-0@lo:501: Request processed in 105us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045212.827232:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784045212.827259:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d87d6476 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873740032:0@lo:501: 00000100:00100000:0.0:1784045212.827282:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d87d6476 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873740160:0@lo:503: 00000100:00100000:0.0:1784045212.827613:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.827676:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aaaef0da going to sleep for 11 seconds 00000100:00100000:2.0:1784045212.838048:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873740160 00000100:00100000:2.0:1784045212.838063:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873740160 00000100:00100000:2.0:1784045212.838124:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784045212.838134:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b1c9c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873740160:12345-0@lo:503: 00000100:00100000:2.0:1784045212.838287:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b1c9c70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873740160:12345-0@lo:503: Request processed in 154us (10674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045212.838305:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784045212.838415:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d87d6476 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873740160:0@lo:503: 00000100:00100000:0.0:1784045212.838661:0:7889:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d87d6476 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:7889:1870706873740288:0@lo:502: 00000100:00100000:0.0:1784045212.838704:0:7889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.838733:0:7889:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c9f0f339 going to sleep for 11 seconds 00000100:00100000:2.0:1784045212.839414:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873740288 00000100:00100000:2.0:1784045212.839421:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873740288 00000100:00100000:2.0:1784045212.839478:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784045212.839485:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ab520c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7889:x1870706873740288:12345-0@lo:502: 00000100:00100000:2.0:1784045212.839607:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ab520c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7889:x1870706873740288:12345-0@lo:502: Request processed in 122us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045212.839614:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784045212.839714:0:7889:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d87d6476 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:7889:1870706873740288:0@lo:502: 00000100:00100000:0.0:1784045212.839764:0:7889:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d87d6476 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:7889:1870706873740416:0@lo:502: 00000100:00100000:0.0:1784045212.839801:0:7889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.839842:0:7889:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aaaef0da going to sleep for 11 seconds 00000100:00100000:2.0:1784045212.839942:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873740416 00000100:00100000:2.0:1784045212.839946:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873740416 00000100:00100000:2.0:1784045212.839976:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784045212.839981:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033aba950 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7889:x1870706873740416:12345-0@lo:502: 00000100:00100000:2.0:1784045212.840045:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033aba950 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:7889:x1870706873740416:12345-0@lo:502: Request processed in 63us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045212.840060:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784045212.840137:0:7889:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d87d6476 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:7889:1870706873740416:0@lo:502: 00000040:00080000:0.0:1784045212.840155:0:7889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1784045212.841409:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1784045212.841441:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784045212.841476:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000d2b296dc/0x5475624df454c2a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2af expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.841487:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000d2b296dc/0x5475624df454c2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2af expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045212.841496:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784045212.841499:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939c9775c000 from 4 10000000:01000000:2.0:1784045212.841501:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784045212.841533:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 000000005c8c805f/0x5475624df454c2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.841540:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 000000005c8c805f/0x5475624df454c2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.841550:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 000000005c8c805f/0x5475624df454c2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045212.841576:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000004ceb6e3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873740544:0@lo:101: 00000100:00100000:2.0:1784045212.841627:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045212.841666:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 0000000017811ad1 going to sleep for 11 seconds 00000100:00100000:0.0:1784045212.841758:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873740544 00000100:00100000:0.0:1784045212.841765:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873740544 00000100:00100000:0.0:1784045212.841806:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784045212.841821:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f37eef52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873740544:12345-0@lo:101: 00010000:00010000:0.0:1784045212.841832:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045212.841844:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000087989717/0x5475624df454c2bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c2b6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045212.841864:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087989717/0x5475624df454c2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c2b6 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045212.841872:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000087989717/0x5475624df454c2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c2b6 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045212.841880:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000087989717, rc 0) 00000100:00100000:0.0:1784045212.841929:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f37eef52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873740544:12345-0@lo:101: Request processed in 117us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045212.841948:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784045212.842082:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000004ceb6e3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873740544:0@lo:101: 00010000:00010000:1.0:1784045212.842096:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 000000005c8c805f/0x5475624df454c2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.842114:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 000000005c8c805f/0x5475624df454c2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c2bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045212.842159:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068bf3df3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873740672:0@lo:256: 00000100:00100000:1.0:1784045212.842193:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045212.842216:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afdf0678 going to sleep for 11 seconds 00000100:00100000:2.0:1784045212.842256:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873740672 00000100:00100000:2.0:1784045212.842261:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873740672 00000100:00100000:2.0:1784045212.842301:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784045212.842307:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a27676f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873740672:12345-0@lo:256: 20000000:01000000:2.0:1784045212.842321:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784045212.842340:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784045212.842342:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1784045212.842428:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a27676f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873740672:12345-0@lo:256: Request processed in 121us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045212.842435:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784045212.842620:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068bf3df3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873740672:0@lo:256: 10000000:01000000:1.0:1784045212.842661:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784045212.842667:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 000000005c8c805f/0x5475624df454c2b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.842674:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 000000005c8c805f/0x5475624df454c2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045212.842681:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784045212.842683:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1784045212.842686:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784045212.842701:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.842707:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.842713:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045212.842724:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068bf3df3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873740800:0@lo:101: 00000100:00100000:1.0:1784045212.842758:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045212.842785:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afdf0678 going to sleep for 11 seconds 00000100:00100000:1.0:1784045212.842798:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873740800 00000100:00100000:1.0:1784045212.842802:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873740800 00000100:00100000:1.0:1784045212.842832:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784045212.842838:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8505dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873740800:12345-0@lo:101: 00010000:00010000:1.0:1784045212.842845:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045212.842853:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f048afce/0x5475624df454c2cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c2c4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.842867:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f048afce/0x5475624df454c2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c2c4 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.842874:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f048afce/0x5475624df454c2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c2c4 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.842881:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f048afce, rc 0) 00000100:00100000:1.0:1784045212.842909:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8505dbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873740800:12345-0@lo:101: Request processed in 72us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045212.842915:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784045212.842946:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068bf3df3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873740800:0@lo:101: 00010000:00010000:1.0:1784045212.842956:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c2c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.842962:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c2c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c2cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045212.843008:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068bf3df3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873740928:0@lo:501: 00000100:00100000:1.0:1784045212.843040:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045212.843052:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afdf0678 going to sleep for 11 seconds 00000100:00100000:1.0:1784045212.843062:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873740928 00000100:00100000:1.0:1784045212.843065:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873740928 00000100:00100000:1.0:1784045212.843081:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784045212.843085:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3c51e6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873740928:12345-0@lo:501: 00000100:00100000:1.0:1784045212.843192:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3c51e6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873740928:12345-0@lo:501: Request processed in 105us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045212.843198:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784045212.843224:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068bf3df3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873740928:0@lo:501: 00000100:00100000:1.0:1784045212.843250:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068bf3df3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873741056:0@lo:503: 00000100:00100000:1.0:1784045212.843286:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045212.843595:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afdf0678 going to sleep for 11 seconds 00000100:00100000:1.0:1784045212.843608:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873741056 00000100:00100000:1.0:1784045212.843611:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873741056 00000100:00100000:1.0:1784045212.843628:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784045212.843633:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a251ad4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873741056:12345-0@lo:503: 00000100:00100000:1.0:1784045212.843707:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a251ad4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873741056:12345-0@lo:503: Request processed in 74us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045212.843714:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784045212.843751:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068bf3df3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873741056:0@lo:503: 00000100:00100000:1.0:1784045212.844161:0:7890:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068bf3df3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:7890:1870706873741184:0@lo:502: 00000100:00100000:1.0:1784045212.844198:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045212.844226:0:7890:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ed275ad going to sleep for 11 seconds 00000100:00100000:0.0:1784045212.844265:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873741184 00000100:00100000:0.0:1784045212.844269:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873741184 00000100:00100000:0.0:1784045212.844393:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784045212.844401:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b65d132 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:7890:x1870706873741184:12345-0@lo:502: 00000100:00100000:0.0:1784045212.844529:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b65d132 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:7890:x1870706873741184:12345-0@lo:502: Request processed in 129us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045212.844535:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784045212.844622:0:7890:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068bf3df3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:7890:1870706873741184:0@lo:502: 00000020:01000000:2.0:1784045212.844643:0:7890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045212.844653:0:7890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045212.844655:0:7890:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1784045212.844662:0:7890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784045212.844665:0:7890:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:00000080:2.0:1784045212.844689:0:7890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045212.844711:0:7890:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000005ef72bdf) 00000020:00000080:2.0:1784045212.844729:0:7890:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1784045212.844736:0:7890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784045212.844808:0:7890:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1784045212.844824:0:7890:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784045212.844832:0:7890:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454c2d9 00010000:00080000:2.0:1784045212.844861:0:7890:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000492d5213@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:2.0:1784045212.853148:0:7890:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1784045212.856853:0:7890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784045212.856868:0:7890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1784045212.856904:0:7890:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784045212.856927:0:7890:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454c2e0 00000100:00080000:2.0:1784045212.856938:0:7890:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784045212.856943:0:7890:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000492d5213 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045212.856977:0:7890:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000038040781 x1870706873741312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784045212.857078:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000038040781 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873741312:0@lo:38: 00000100:00100000:1.0:1784045212.857157:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045212.859797:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873741312 00000100:00100000:3.0:1784045212.859811:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873741312 00000100:00100000:3.0:1784045212.859853:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045212.859860:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054077bc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1870706873741312:12345-0@lo:38: 00010000:00080000:3.0:1784045212.859889:0:6501:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:3.0:1784045212.859925:0:6501:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454c2e7 00000004:00100000:3.0:1784045212.859940:0:6501:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1784045212.859945:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1784045212.863336:0:7890:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1784045212.863427:0:7890:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1784045212.864165:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045212.864184:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d87d6476 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873741440:0@lo:400: 00000100:00100000:0.0:1784045212.864252:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.864489:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873741568:0@lo:400: 00000100:00100000:0.0:1784045212.864520:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.864540:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045212.864545:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873741696:0@lo:400: 00000100:00100000:0.0:1784045212.864577:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.864610:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873741440 00000100:00100000:0.0:1784045212.864617:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873741440 00000100:00100000:2.0:1784045212.864732:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1784045212.864742:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1784045212.864886:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873741696 00000100:00100000:0.0:1784045212.864890:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873741696 00000100:00100000:0.0:1784045212.864910:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045212.864916:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee142448 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873741440:12345-0@lo:400: 00000100:00100000:0.0:1784045212.864970:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee142448 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873741440:12345-0@lo:400: Request processed in 53us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045212.864978:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045212.864994:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045212.864999:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006753aa60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873741696:12345-0@lo:400: 00000100:00100000:0.0:1784045212.865037:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006753aa60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873741696:12345-0@lo:400: Request processed in 38us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045212.865042:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784045212.865087:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d87d6476 x1870706873741440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045212.865101:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d87d6476 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873741440:0@lo:400: 00010000:00080000:0.0:1784045212.865135:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003fc85705 x1870706873741696/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045212.865144:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873741696:0@lo:400: 00000100:00080000:0.0:1784045212.865473:0:7896:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000003fc85705 x1870706873741824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045212.865483:0:7896:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c66d2863 going to sleep for 0 seconds 00000020:01000000:2.0:1784045212.865591:0:7890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045212.865598:0:7890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045212.865600:0:7890:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1784045212.865603:0:7890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045212.865607:0:7890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045212.865608:0:7890:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784045212.865611:0:7890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784045212.865612:0:7890:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784045212.865632:0:7890:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000191b0630 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:7890:1870706873741952:0@lo:502: 00000100:00100000:2.0:1784045212.865690:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045212.865724:0:7890:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a1c93e16 going to sleep for 11 seconds 00000100:00100000:0.0:1784045212.865811:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873741952 00000100:00100000:0.0:1784045212.865816:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873741952 00000100:00100000:0.0:1784045212.865853:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784045212.865859:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa0395a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:7890:x1870706873741952:12345-0@lo:502: 00000100:00100000:0.0:1784045212.865966:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa0395a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:7890:x1870706873741952:12345-0@lo:502: Request processed in 108us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045212.865974:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784045212.866257:0:7890:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000191b0630 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:7890:1870706873741952:0@lo:502: 00000020:01000000:2.0:1784045212.866279:0:7890:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045212.866283:0:7890:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045212.866285:0:7890:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784045212.866288:0:7890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1784045212.866527:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1784045212.866546:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784045212.866562:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c2c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.866572:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 0000000068846607/0x5475624df454c2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045212.866581:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784045212.866583:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff939c901d3380 from 1 10000000:01000000:1.0:1784045212.866586:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784045212.866608:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c2ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.866615:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c2ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.866622:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c2ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045212.866634:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000056475a86 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873742080:0@lo:101: 00000100:00100000:1.0:1784045212.866737:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045212.866767:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 000000009bf0e370 going to sleep for 11 seconds 00000100:00100000:2.0:1784045212.867758:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873742080 00000100:00100000:2.0:1784045212.867767:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873742080 00000100:00100000:2.0:1784045212.867815:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784045212.867822:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d53530a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873742080:12345-0@lo:101: 00010000:00010000:2.0:1784045212.867835:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045212.867849:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c25b9c1/0x5475624df454c2f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c2ee expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.867872:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c25b9c1/0x5475624df454c2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c2ee expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.867882:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c25b9c1/0x5475624df454c2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c2ee expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.867898:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c25b9c1, rc 0) 00000100:00100000:2.0:1784045212.867951:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d53530a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873742080:12345-0@lo:101: Request processed in 130us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045212.867958:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784045212.868000:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000056475a86 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873742080:0@lo:101: 00010000:00010000:2.0:1784045212.868016:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c2ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.868024:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c2ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c2f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045212.868085:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000191b0630 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873742208:0@lo:501: 00000100:00100000:2.0:1784045212.868116:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045212.868140:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dfe7b570 going to sleep for 11 seconds 00000100:00100000:2.0:1784045212.868153:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873742208 00000100:00100000:2.0:1784045212.868156:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873742208 00000100:00100000:2.0:1784045212.868194:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784045212.868199:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025ca6ed5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873742208:12345-0@lo:501: 00000100:00100000:2.0:1784045212.868272:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025ca6ed5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873742208:12345-0@lo:501: Request processed in 72us (155us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045212.868278:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784045212.868638:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000191b0630 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873742208:0@lo:501: 10000000:01000000:3.0:1784045212.868668:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784045212.868674:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c2ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045212.868681:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: 00000000773255c2/0x5475624df454c2ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c2f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045212.868842:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873741568 00000100:00100000:3.0:1784045212.868847:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873741568 00000100:00100000:3.0:1784045212.868941:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784045212.868948:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000356355e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873741568:12345-0@lo:400: 00000100:00100000:3.0:1784045212.869002:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000356355e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873741568:12345-0@lo:400: Request processed in 55us (4482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045212.869008:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784045212.869046:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873741568:0@lo:400: 00000100:00080000:1.0:1784045212.878743:0:6501:0:(import.c:65:import_set_state_nolock()) 000000008518c6a4 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784045212.878864:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054077bc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1870706873741312:12345-0@lo:38: Request processed in 19003us (21707us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045212.878876:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045212.879033:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784045212.879043:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784045212.879051:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784045212.879056:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784045212.879058:0:3622:0:(import.c:65:import_set_state_nolock()) 00000000492d5213 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1784045212.879076:0:3622:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c66d2863): req@000000003fc85705 x1870706873741824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045212.879092:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000038040781 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873741312:0@lo:38: 00000100:00100000:0.0:1784045212.879712:0:7896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.879747:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873741824 00000100:00100000:0.0:1784045212.879753:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873741824 00000100:00100000:0.0:1784045212.879792:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784045212.879800:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d87d6476 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7896:x1870706873741824:12345-0@lo:1000: 00000100:00100000:0.0:1784045212.879868:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d87d6476 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7896:x1870706873741824:12345-0@lo:1000: Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045212.879883:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784045212.879924:0:7896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7896:1870706873741824:0@lo:1000: 00000040:01000000:0.0:1784045212.879954:0:7896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784045212.879987:0:7896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7896:1870706873742336:0@lo:1000: 00000100:00100000:0.0:1784045212.880016:0:7896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.880036:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873742336 00000100:00100000:0.0:1784045212.880040:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873742336 00000100:00100000:0.0:1784045212.880059:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784045212.880064:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000669bdb19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7896:x1870706873742336:12345-0@lo:1000: 00000100:00100000:0.0:1784045212.880147:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000669bdb19 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7896:x1870706873742336:12345-0@lo:1000: Request processed in 82us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045212.880153:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784045212.880170:0:7896:0:(client.c:2702:ptlrpc_set_wait()) set 000000008c3e65d3 going to sleep for 11 seconds 00000100:00100000:0.0:1784045212.880181:0:7896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7896:1870706873742336:0@lo:1000: 00000100:00100000:0.0:1784045212.880218:0:7896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7896:1870706873742464:0@lo:700: 00000100:00100000:0.0:1784045212.880241:0:7896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.880269:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873742464 00000100:00100000:0.0:1784045212.880273:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873742464 00000100:00100000:0.0:1784045212.880309:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045212.880315:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000523c27e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7896:x1870706873742464:12345-0@lo:700: 00000100:00100000:0.0:1784045212.880349:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000523c27e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7896:x1870706873742464:12345-0@lo:700: Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045212.880356:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045212.880371:0:7896:0:(client.c:2702:ptlrpc_set_wait()) set 000000009bc9e05a going to sleep for 11 seconds 00000100:00100000:0.0:1784045212.880382:0:7896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7896:1870706873742464:0@lo:700: 00000100:00100000:0.0:1784045212.880593:0:7896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7896:1870706873742592:0@lo:1000: 00000100:00100000:0.0:1784045212.880617:0:7896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.880637:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873742592 00000100:00100000:0.0:1784045212.880640:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873742592 00000100:00100000:0.0:1784045212.880660:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045212.880665:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000407f5f9c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7896:x1870706873742592:12345-0@lo:1000: 00000100:00100000:0.0:1784045212.880707:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000407f5f9c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7896:x1870706873742592:12345-0@lo:1000: Request processed in 42us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045212.880713:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045212.880730:0:7896:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b9de881 going to sleep for 11 seconds 00000100:00100000:0.0:1784045212.880741:0:7896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7896:1870706873742592:0@lo:1000: 00000004:00080000:0.0:1784045212.880779:0:7896:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000009bc9e05a with version 0 00000020:00100000:0.0:1784045212.880791:0:7896:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784045212.880796:0:7896:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003fc85705 x1870706873742848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784045212.880809:0:7896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7896:1870706873742848:0@lo:1000: 00000100:00100000:0.0:1784045212.880831:0:7896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.880848:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873742848 00000100:00100000:0.0:1784045212.880851:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873742848 00000100:00100000:0.0:1784045212.880872:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784045212.880877:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072c5da2a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7896:x1870706873742848:12345-0@lo:1000: 00000100:00100000:0.0:1784045212.881390:0:7896:0:(client.c:2702:ptlrpc_set_wait()) set 000000007fba4aa6 going to sleep for 11 seconds 00000100:00100000:2.0:1784045212.881784:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045212.881797:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d899817b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873742976:0@lo:41: 00000100:00100000:2.0:1784045212.881841:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045212.881913:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873742976 00000100:00100000:1.0:1784045212.881919:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873742976 00000100:00100000:1.0:1784045212.881949:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784045212.881954:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb37def8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3626:x1870706873742976:12345-0@lo:41: 00000004:00000024:1.0:1784045212.881976:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1784045212.882026:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb37def8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:3626:x1870706873742976:12345-0@lo:41: Request processed in 71us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045212.882032:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045212.882202:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d899817b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873742976:0@lo:41: 00000001:00080000:3.0:1784045212.887609:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1784045212.887623:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784045212.887802:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072c5da2a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7896:x1870706873742848:12345-0@lo:1000: Request processed in 6921us (6967us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784045212.887823:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1784045212.887961:0:7896:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1784045212.887967:0:7896:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784045212.887982:0:7896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fc85705 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7896:1870706873742848:0@lo:1000: 00000100:00100000:1.0:1784045212.888071:0:7896:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e12d549c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7896:1870706873743104:0@lo:1000: 00000100:00100000:1.0:1784045212.888111:0:7896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045212.888143:0:7896:0:(client.c:2702:ptlrpc_set_wait()) set 00000000865323b4 going to sleep for 11 seconds 00000100:00100000:0.0:1784045212.888203:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873743104 00000100:00100000:0.0:1784045212.888215:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873743104 00000100:00100000:0.0:1784045212.888259:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045212.888266:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020d99ad6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7896:x1870706873743104:12345-0@lo:1000: 00000100:00100000:0.0:1784045212.888347:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020d99ad6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7896:x1870706873743104:12345-0@lo:1000: Request processed in 82us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045212.888354:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784045212.888482:0:7896:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e12d549c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7896:1870706873743104:0@lo:1000: 00000040:00080000:1.0:1784045212.888499:0:7896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1784045212.888527:0:7896:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000803ebb33 with version 1 00000004:00080000:0.0:1784045212.890399:0:7893:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000004178dc65 version 1 rpc_version 1 00000020:00100000:0.0:1784045212.890439:0:7893:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1784045212.890469:0:7893:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000737c44b7 x1870706873743360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784045212.890492:0:7893:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000737c44b7 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7893:1870706873743360:0@lo:1000: 00000100:00100000:0.0:1784045212.890549:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.890598:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873743360 00000100:00100000:0.0:1784045212.890604:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873743360 00000100:00100000:0.0:1784045212.890657:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784045212.890665:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fc85705 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7893:x1870706873743360:12345-0@lo:1000: 00000100:00100000:0.0:1784045212.891136:0:7893:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ee09ade3 going to sleep for 11 seconds 00000040:00080000:1.0:1784045212.892282:0:7896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784045212.895520:0:7896:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784045212.895530:0:7896:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1784045212.898403:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1784045212.908960:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fc85705 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7893:x1870706873743360:12345-0@lo:1000: Request processed in 18289us (18404us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784045212.908976:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1784045212.909187:0:7893:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1784045212.909191:0:7893:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1784045212.909207:0:7893:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000737c44b7 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7893:1870706873743360:0@lo:1000: 00000020:00000080:3.0:1784045212.928242:0:7903:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca0a236f0 20000000:00000080:3.0:1784045212.928261:0:7903:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939cb58ae400 uarg=0000000000000000 20000000:01000000:3.0:1784045212.928576:0:7903:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1784045212.928584:0:7903:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1784045212.928588:0:7903:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1784045212.928660:0:7903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1784045212.928672:0:7903:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1784045212.933544:0:7903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784045212.933796:0:7903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784045212.933828:0:7903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1784045212.933846:0:7903:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1784045212.933862:0:7903:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784045212.933880:0:7903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045212.933907:0:7903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f369aef1/0x5475624df454c17b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c174 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045212.933914:0:7903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000dbfda3d5/0x5475624df454c269 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c262 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045212.933921:0:7903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045212.933957:0:7903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000dbfda3d5/0x5475624df454c269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c262 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045212.933969:0:7903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000dbfda3d5/0x5475624df454c269 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c262 expref: 17 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045212.933984:0:7903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001afeb9c5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7903:1870706873743488:0@lo:104: 00000100:00100000:3.0:1784045212.934605:0:7903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784045212.934702:0:7903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f369aef1/0x5475624df454c17b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c174 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045212.934711:0:7903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f369aef1/0x5475624df454c17b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c174 expref: 17 pid: 6489 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045212.934719:0:7903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ffc3113e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7903:1870706873743616:0@lo:104: 00000100:00100000:3.0:1784045212.934740:0:7903:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d30d5df6 going to sleep for 11 seconds 00000100:00100000:0.0:1784045212.934940:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784045212.934960:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045212.935245:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873743488 00000100:00100000:0.0:1784045212.935253:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873743488 00000100:00100000:2.0:1784045212.935377:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873743616 00000100:00100000:2.0:1784045212.935382:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873743616 00000100:00100000:2.0:1784045212.935405:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784045212.935413:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba38a736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:7903:x1870706873743488:12345-0@lo:104: 00010000:00010000:2.0:1784045212.935425:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c269 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.935518:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784045212.935524:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba38a736 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:7903:x1870706873743488:12345-0@lo:104: Request processed in 112us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045212.935530:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784045212.935575:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784045212.935582:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000737c44b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:7903:x1870706873743616:12345-0@lo:104: 00010000:00010000:2.0:1784045212.935589:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c17b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.935607:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045212.935614:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c269 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.935623:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad1e9e16 already unused, calling callback (0000000087fd0cac) 00010000:00010000:2.0:1784045212.935625:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1784045212.935626:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c269 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045212.935635:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000737c44b7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:7903:x1870706873743616:12345-0@lo:104: Request processed in 52us (673us total) trans 0 rc 0/0 00010000:00010000:1.0:1784045212.935643:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c269 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045212.935644:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 10000000:00010000:1.0:1784045212.935661:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c269 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.935662:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1784045212.935671:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784045212.935720:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c269 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.935728:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045212.935748:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c269 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.935754:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 00000000ad1e9e16/0x5475624df454c262 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c269 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.935767:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045212.935768:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045212.935770:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045212.935790:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e12d549c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873743744:0@lo:103: 00000100:00100000:1.0:1784045212.935825:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045212.935871:0:7903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001afeb9c5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7903:1870706873743488:0@lo:104: 00000100:00100000:3.0:1784045212.935884:0:7903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ffc3113e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7903:1870706873743616:0@lo:104: 00010000:00010000:3.0:1784045212.935906:0:7903:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045212.935971:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873743744 00000100:00100000:2.0:1784045212.935976:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873743744 00010000:00010000:2.0:1784045212.935992:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000dbfda3d5/0x5475624df454c269 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c262 expref: 18 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045212.936085:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784045212.936092:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d899817b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:3626:x1870706873743744:12345-0@lo:103: 00010000:00010000:2.0:1784045212.936111:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045212.936116:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000dbfda3d5/0x5475624df454c269 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c262 expref: 18 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.936125:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000dbfda3d5/0x5475624df454c269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c262 expref: 18 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.936138:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dbfda3d5/0x5475624df454c269 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c262 expref: 18 pid: 6488 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.936149:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045212.936188:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d899817b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:3626:x1870706873743744:12345-0@lo:103: Request processed in 97us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045212.936195:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1784045212.936251:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045212.936256:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c17b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.936263:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008ce2c46f already unused, calling callback (0000000087fd0cac) 10000000:00010000:2.0:1784045212.936265:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c17b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.936270:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c17b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045212.936275:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c17b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045212.936280:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1784045212.936508:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e12d549c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873743744:0@lo:103: 00010000:00010000:2.0:1784045212.937489:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c17b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.937508:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045212.937548:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c17b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.937563:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: 000000008ce2c46f/0x5475624df454c174 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c17b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045212.937588:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045212.937589:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1784045212.937591:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045212.937595:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045212.937605:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045212.937607:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fdeac0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873743872:0@lo:103: 00010000:00010000:2.0:1784045212.937608:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045212.937664:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045212.937730:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873743872 00000100:00100000:1.0:1784045212.937737:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873743872 00010000:00010000:1.0:1784045212.937759:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f369aef1/0x5475624df454c17b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c174 expref: 17 pid: 6489 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045212.937793:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784045212.937802:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056475a86 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:3624:x1870706873743872:12345-0@lo:103: 00010000:00010000:1.0:1784045212.937821:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045212.937827:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f369aef1/0x5475624df454c17b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c174 expref: 17 pid: 6489 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.937838:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f369aef1/0x5475624df454c17b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c174 expref: 17 pid: 6489 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.937853:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f369aef1/0x5475624df454c17b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c174 expref: 17 pid: 6489 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.937865:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.937872:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.937887:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.937894:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.937901:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.937908:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.937914:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003f1c80c4 already unused, calling callback (0000000010207b6b) 00010000:00010000:1.0:1784045212.937917:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.937934:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.937956:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045212.937966:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045212.937986:0:7903:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045212.937996:0:7903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045212.938002:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003f1c80c4/0x5475624df454c2fc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045212.938008:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056475a86 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:3624:x1870706873743872:12345-0@lo:103: Request processed in 207us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045212.938017:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784045212.938398:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fdeac0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873743872:0@lo:103: 00010000:00010000:1.0:1784045213.654342:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045214.355912:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045214.355933:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873744000:0@lo:41: 00000100:00100000:3.0:1784045214.356001:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045214.356189:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873744000 00000100:00100000:0.0:1784045214.356203:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873744000 00000100:00100000:0.0:1784045214.356252:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045214.356259:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffc3113e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873744000:12345-0@lo:41: 00000004:00000024:0.0:1784045214.356360:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1784045214.356409:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffc3113e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873744000:12345-0@lo:41: Request processed in 151us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045214.356416:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045214.356476:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873744000:0@lo:41: 00010000:00010000:2.0:1784045214.676931:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045215.699679:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045216.724882:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045217.750981:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045217.942170:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001afeb9c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873744128:0@lo:400: 00000100:00100000:3.0:1784045217.942480:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045217.942549:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a28a0329 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873744640:0@lo:400: 00000100:00100000:2.0:1784045217.942803:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873744128 00000100:00100000:2.0:1784045217.942815:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873744128 00000100:00100000:2.0:1784045217.942878:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784045217.942887:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065f3cdd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:3625:x1870706873744128:12345-0@lo:400: 00000100:00100000:1.0:1784045217.945660:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002407edc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873744384:0@lo:400: 00000100:00100000:2.0:1784045217.945994:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065f3cdd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:3625:x1870706873744128:12345-0@lo:400: Request processed in 3105us (3511us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045217.946007:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784045217.946551:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008476893b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873744512:0@lo:400: 00000100:00100000:2.0:1784045217.946704:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045217.946771:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873744512 00000100:00100000:2.0:1784045217.946779:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873744512 00000100:00100000:2.0:1784045217.947254:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784045217.947263:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a6bc073 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873744512:12345-0@lo:400: 00000100:00100000:2.0:1784045217.947582:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a6bc073 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873744512:12345-0@lo:400: Request processed in 320us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045217.947787:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1784045217.947985:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008476893b x1870706873744512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045217.947999:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008476893b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873744512:0@lo:400: 00000100:00100000:3.0:1784045217.949175:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045217.949260:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873744640 00000100:00100000:3.0:1784045217.949271:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873744640 00000100:00100000:3.0:1784045217.949340:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784045217.949350:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b56f84e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873744640:12345-0@lo:400: 00000100:00100000:3.0:1784045217.949463:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b56f84e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873744640:12345-0@lo:400: Request processed in 114us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045217.949471:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784045217.949546:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a28a0329 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873744640:0@lo:400: 00000100:00100000:3.0:1784045217.950550:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001afeb9c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873744128:0@lo:400: 00000100:00100000:3.0:1784045217.950651:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784045217.950666:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005d213ca9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873744256:0@lo:400: 00000100:00100000:3.0:1784045217.951869:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045217.951924:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068bf3df3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873744768:0@lo:41: 00000100:00100000:2.0:1784045217.952025:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873744256 00000100:00100000:2.0:1784045217.952040:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873744256 00000100:00100000:2.0:1784045217.952111:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784045217.952119:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001afeb9c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873744256:12345-0@lo:400: 00000100:00100000:2.0:1784045217.952208:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001afeb9c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873744256:12345-0@lo:400: Request processed in 89us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045217.952215:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045217.952863:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045217.952912:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873744768 00000100:00100000:3.0:1784045217.952918:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873744768 00000100:00100000:3.0:1784045217.953035:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784045217.953044:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a28a0329 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873744768:12345-0@lo:41: 00000004:00000024:3.0:1784045217.953084:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1784045217.953127:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a28a0329 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873744768:12345-0@lo:41: Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045217.953405:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045217.953559:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873744384 00000100:00100000:1.0:1784045217.953564:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873744384 00000100:00100000:3.0:1784045217.953756:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784045217.953879:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784045217.953886:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5780133 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873744384:12345-0@lo:400: 00000100:00100000:3.0:1784045217.954129:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068bf3df3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873744768:0@lo:41: 00010000:00080000:3.0:1784045217.954161:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005d213ca9 x1870706873744256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045217.954173:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005d213ca9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873744256:0@lo:400: 00000100:00100000:1.0:1784045217.954513:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5780133 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873744384:12345-0@lo:400: Request processed in 626us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045217.954537:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784045217.954888:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002407edc9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873744384:0@lo:400: 00010000:00010000:2.0:1784045218.773213:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045219.477294:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045219.477328:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c923399a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873744896:0@lo:41: 00000100:00100000:2.0:1784045219.477431:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045219.477941:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873744896 00000100:00100000:2.0:1784045219.477953:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873744896 00000100:00100000:2.0:1784045219.478010:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784045219.478020:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076bbfb61 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873744896:12345-0@lo:41: 00000004:00000024:2.0:1784045219.478065:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1784045219.478119:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076bbfb61 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873744896:12345-0@lo:41: Request processed in 101us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045219.478127:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784045219.478179:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c923399a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873744896:0@lo:41: 00010000:00010000:3.0:1784045219.795760:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045220.823018:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784045221.015255:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784045221.015261:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939c9157c000 from 1 10000000:01000000:0.0:1784045221.015265:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784045221.015304:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: 00000000cd39a1e5/0x5475624df454c303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.015314:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: 00000000cd39a1e5/0x5475624df454c303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.015324:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: 00000000cd39a1e5/0x5475624df454c303 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045221.015345:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873745024:0@lo:101: 00000100:00100000:0.0:1784045221.015410:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045221.015473:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a71b57e going to sleep for 11 seconds 00000100:00100000:0.0:1784045221.015493:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873745024 00000100:00100000:0.0:1784045221.015500:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873745024 00000100:00100000:0.0:1784045221.015560:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784045221.015568:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049aa8f78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873745024:12345-0@lo:101: 00010000:00010000:0.0:1784045221.015580:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045221.015591:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000796439ff/0x5475624df454c30a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c303 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.015620:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000796439ff/0x5475624df454c30a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c303 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.015629:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000796439ff/0x5475624df454c30a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c303 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.015638:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000796439ff, rc 0) 00000100:00100000:0.0:1784045221.015676:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049aa8f78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873745024:12345-0@lo:101: Request processed in 109us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045221.015682:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784045221.015729:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873745024:0@lo:101: 00010000:00010000:0.0:1784045221.015743:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: 00000000cd39a1e5/0x5475624df454c303 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c30a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.015752:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: 00000000cd39a1e5/0x5475624df454c303 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c30a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045221.015811:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873745152:0@lo:501: 00000100:00100000:0.0:1784045221.015837:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045221.015852:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a71b57e going to sleep for 11 seconds 00000100:00100000:0.0:1784045221.015864:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873745152 00000100:00100000:0.0:1784045221.015867:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873745152 00000100:00100000:0.0:1784045221.015888:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784045221.015893:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003edd31b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873745152:12345-0@lo:501: 00000100:00100000:0.0:1784045221.016000:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003edd31b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873745152:12345-0@lo:501: Request processed in 107us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045221.016006:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784045221.016044:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873745152:0@lo:501: 00000100:00100000:0.0:1784045221.016067:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873745280:0@lo:503: 00000100:00100000:0.0:1784045221.016102:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045221.016113:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a71b57e going to sleep for 11 seconds 00000100:00100000:0.0:1784045221.016123:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873745280 00000100:00100000:0.0:1784045221.016126:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873745280 00000100:00100000:0.0:1784045221.016143:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784045221.016148:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4f71872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873745280:12345-0@lo:503: 00000100:00100000:0.0:1784045221.016213:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4f71872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873745280:12345-0@lo:503: Request processed in 65us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045221.016219:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784045221.016251:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873745280:0@lo:503: 00000100:00100000:0.0:1784045221.025347:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8319:1870706873745408:0@lo:502: 00000100:00100000:0.0:1784045221.025429:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045221.025481:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873745408 00000100:00100000:0.0:1784045221.025487:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873745408 00000100:00100000:0.0:1784045221.025539:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784045221.025547:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f41f59f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:8319:x1870706873745408:12345-0@lo:502: 00000100:00100000:0.0:1784045221.025658:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f41f59f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:8319:x1870706873745408:12345-0@lo:502: Request processed in 111us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045221.025666:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784045221.025712:0:8319:0:(client.c:2702:ptlrpc_set_wait()) set 000000008a71b57e going to sleep for 11 seconds 00000100:00100000:0.0:1784045221.029406:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a308baa0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8319:1870706873745408:0@lo:502: 00000020:01000000:0.0:1784045221.029464:0:8319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045221.029474:0:8319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045221.029477:0:8319:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784045221.029490:0:8319:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939c9157c000 00000020:00000080:0.0:1784045221.029493:0:8319:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784045221.029560:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8319:1870706873745536:0@lo:502: 00000100:00100000:0.0:1784045221.029624:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045221.029664:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873745536 00000100:00100000:0.0:1784045221.029670:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873745536 00000100:00100000:0.0:1784045221.029709:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784045221.029717:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:8319:x1870706873745536:12345-0@lo:502: 00000100:00100000:0.0:1784045221.030960:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:8319:x1870706873745536:12345-0@lo:502: Request processed in 1238us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045221.030970:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784045221.031032:0:8319:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045221.031053:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8319:1870706873745536:0@lo:502: 00000020:01000000:0.0:1784045221.031078:0:8319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045221.031085:0:8319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045221.031088:0:8319:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784045221.031091:0:8319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1784045221.031156:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784045221.032346:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784045221.032359:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c303 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c30a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.032371:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c30a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045221.032380:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784045221.032383:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939c9775c000 from 1 10000000:01000000:0.0:1784045221.032385:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784045221.032415:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.032429:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.032440:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045221.032475:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873745664:0@lo:101: 00000100:00100000:0.0:1784045221.032540:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045221.032575:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045221.032594:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873745664 00000100:00100000:0.0:1784045221.032600:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873745664 00000100:00100000:0.0:1784045221.032641:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784045221.032649:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873745664:12345-0@lo:101: 00010000:00010000:0.0:1784045221.032661:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045221.032674:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915aae00/0x5475624df454c318 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c311 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.032697:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915aae00/0x5475624df454c318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c311 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.032707:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915aae00/0x5475624df454c318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c311 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.032715:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aae00, rc 0) 00000100:00100000:0.0:1784045221.032750:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873745664:12345-0@lo:101: Request processed in 101us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045221.032756:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784045221.034007:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873745664:0@lo:101: 00010000:00010000:0.0:1784045221.034039:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c318 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.034051:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c318 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045221.034114:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873745792:0@lo:501: 00000100:00100000:0.0:1784045221.034156:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045221.036296:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045221.036324:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873745792 00000100:00100000:0.0:1784045221.036333:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873745792 00000100:00100000:0.0:1784045221.036383:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784045221.036391:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873745792:12345-0@lo:501: 00000100:00100000:0.0:1784045221.036733:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873745792:12345-0@lo:501: Request processed in 342us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045221.036741:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784045221.037170:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873745792:0@lo:501: 00000100:00100000:0.0:1784045221.037325:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873745920:0@lo:503: 00000100:00100000:0.0:1784045221.037369:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045221.037391:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045221.037404:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873745920 00000100:00100000:0.0:1784045221.037408:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873745920 00000100:00100000:0.0:1784045221.037435:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784045221.037441:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873745920:12345-0@lo:503: 00000100:00100000:0.0:1784045221.037547:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873745920:12345-0@lo:503: Request processed in 105us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045221.037554:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784045221.037599:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873745920:0@lo:503: 00000100:00100000:0.0:1784045221.041625:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8321:1870706873746048:0@lo:502: 00000100:00100000:0.0:1784045221.041700:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045221.041738:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873746048 00000100:00100000:0.0:1784045221.041743:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873746048 00000100:00100000:0.0:1784045221.041793:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784045221.041801:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:8321:x1870706873746048:12345-0@lo:502: 00000100:00100000:0.0:1784045221.041907:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:8321:x1870706873746048:12345-0@lo:502: Request processed in 105us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045221.041914:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784045221.041969:0:8321:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045221.041990:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8321:1870706873746048:0@lo:502: 00000020:01000000:0.0:1784045221.042015:0:8321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045221.042023:0:8321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045221.042026:0:8321:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784045221.042032:0:8321:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939c9775c000 00000020:00000080:0.0:1784045221.042034:0:8321:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784045221.042068:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8321:1870706873746176:0@lo:502: 00000100:00100000:0.0:1784045221.042099:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045221.042118:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873746176 00000100:00100000:0.0:1784045221.042122:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873746176 00000100:00100000:0.0:1784045221.042143:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784045221.042150:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:8321:x1870706873746176:12345-0@lo:502: 00000100:00100000:0.0:1784045221.042341:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:8321:x1870706873746176:12345-0@lo:502: Request processed in 191us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045221.042347:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784045221.042376:0:8321:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045221.042393:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8321:1870706873746176:0@lo:502: 00000020:01000000:0.0:1784045221.042409:0:8321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045221.042413:0:8321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045221.042414:0:8321:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784045221.042418:0:8321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1784045221.042479:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784045221.042495:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784045221.042514:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c318 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.042525:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c318 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045221.843697:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784045222.586509:0:8405:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784045222.586513:0:8405:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1784045222.586514:0:8405:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1784045222.586646:0:8405:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff939cc10ba000 00000020:01000004:1.0:1784045222.586662:0:8405:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1784045222.586674:0:8405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784045222.586687:0:8405:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff939cb58b0000) 00000020:00000080:1.0:1784045222.586706:0:8405:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784045222.634273:0:8405:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1784045222.634331:0:8405:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1784045222.679313:0:8405:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784045222.679640:0:8405:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784045222.679658:0:8405:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784045222.679669:0:8405:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5475624df454c326 00000020:01000004:2.0:1784045222.679676:0:8405:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1784045222.679698:0:8405:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.144@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784045222.679701:0:8405:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784045222.679707:0:8405:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784045222.679712:0:8405:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784045222.679723:0:8405:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff939c9fddcd40) 00000020:00000080:2.0:1784045222.679734:0:8405:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1784045222.687014:0:8405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045222.687192:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784045222.687198:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1784045222.689984:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1784045222.689998:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1784045222.690789:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1784045222.690813:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1784045222.694303:0:8405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045222.694632:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1784045222.694638:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1784045222.704312:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1784045222.704323:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1784045222.750470:0:8405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045222.750714:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784045222.750720:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1784045222.753482:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784045222.753510:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1784045222.760685:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784045222.761671:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1784045222.766238:0:8405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045222.766422:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1784045222.766429:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1784045222.769113:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1784045222.769126:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1784045222.818180:0:8405:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045222.818618:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1784045222.818626:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1784045222.823147:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1784045222.823163:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1784045222.823836:0:8405:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1784045222.823868:0:8405:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1784045222.823874:0:8405:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1784045222.845019:0:8405:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784045222.845070:0:8405:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.144@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1784045222.845074:0:8405:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784045222.845079:0:8405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784045222.845081:0:8405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045222.845082:0:8405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045222.845083:0:8405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045222.845084:0:8405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045222.845085:0:8405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045222.845087:0:8405:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784045222.845088:0:8405:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784045222.845090:0:8405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045222.845091:0:8405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784045222.845094:0:8405:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1784045222.845096:0:8405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784045222.845097:0:8405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784045222.845099:0:8405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045222.845100:0:8405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045222.845100:0:8405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045222.845101:0:8405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045222.845102:0:8405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045222.845103:0:8405:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784045222.845104:0:8405:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784045222.845105:0:8405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045222.845106:0:8405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784045222.845134:0:8405:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1784045222.845153:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873746304:0@lo:253: 00000100:00100000:3.0:1784045222.845241:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045222.845389:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873746304 00000100:00100000:0.0:1784045222.845396:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873746304 00000100:00100000:0.0:1784045222.845472:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784045222.845482:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:8405:x1870706873746304:12345-0@lo:253: 20000000:01000000:0.0:1784045222.845520:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784045222.845525:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1784045222.845529:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1784045222.845533:0:6488:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000100:00100000:3.0:1784045222.845991:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92ca1300 going to sleep for 11 seconds 00000040:00080000:0.0:1784045222.846155:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045222.846310:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1784045222.846325:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1784045222.846341:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1784045222.846347:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1784045222.846358:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1784045222.846664:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1784045222.846766:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1784045222.847057:0:6488:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.144@tcp 20000000:01000000:0.0:1784045222.847059:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:0.0:1784045222.847080:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1784045222.847087:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784045222.847101:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1784045222.847106:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:0.0:1784045222.847118:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1784045222.847124:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1784045222.847134:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1784045222.847147:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1784045222.847217:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1784045222.847228:0:6488:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.144@tcp 20000000:01000000:0.0:1784045222.847230:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:0.0:1784045222.847243:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1784045222.847248:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784045222.847259:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1784045222.847265:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:0.0:1784045222.847276:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1784045222.847282:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1784045222.847295:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1784045222.847309:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1784045222.849145:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1784045222.849171:0:6488:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.144@tcp 20000000:01000000:0.0:1784045222.849173:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:0.0:1784045222.849188:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1784045222.849194:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784045222.849207:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1784045222.849212:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:0.0:1784045222.849226:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1784045222.849232:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1784045222.849262:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1784045222.849277:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1784045222.849291:0:6488:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1784045222.849294:0:6488:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1784045222.849297:0:6488:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1784045222.849354:0:6488:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1784045222.849357:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784045222.852327:0:8424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1784045222.852605:0:8424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1784045222.852624:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1784045222.853176:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1784045222.853219:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1784045222.853237:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1784045222.853248:0:6488:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784045222.853251:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784045222.854043:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1784045222.854228:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1784045222.854250:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1784045222.854265:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1784045222.854274:0:6488:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784045222.854276:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784045222.855072:0:8426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1784045222.855098:0:8426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1784045222.855113:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1784045222.855265:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1784045222.855280:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1784045222.855291:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1784045222.855297:0:6488:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784045222.855299:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784045222.856045:0:8427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1784045222.856075:0:8427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1784045222.856092:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1784045222.856247:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1784045222.856266:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1784045222.856277:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:0.0:1784045222.856291:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784045222.856309:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.856326:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c93e78600/0x5475624df454c200 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c1f9 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.856334:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c93e78800/0x5475624df454c277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c270 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.856677:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c915ab000/0x5475624df454c2af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c2a8 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.856685:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c93e78e00/0x5475624df454c2cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c2c4 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.856693:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc21fda00/0x5475624df454c2f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c2ee expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.856701:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.856742:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc21fda00/0x5475624df454c2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c2ee expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.856984:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc21fda00/0x5475624df454c2f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c2ee expref: 18 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045222.857000:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873746432:0@lo:104: 00000100:00100000:0.0:1784045222.857063:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784045222.857162:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c93e78e00/0x5475624df454c2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c2c4 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.857171:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c93e78e00/0x5475624df454c2cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c2c4 expref: 18 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045222.857180:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915b9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873746560:0@lo:104: 00000100:00100000:0.0:1784045222.857202:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784045222.857339:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c915ab000/0x5475624df454c2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c2a8 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.857365:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c915ab000/0x5475624df454c2af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c2a8 expref: 18 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045222.857383:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873746688:0@lo:104: 00000100:00100000:0.0:1784045222.857409:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045222.857603:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873746432 00000100:00100000:3.0:1784045222.857615:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873746432 00000100:00100000:3.0:1784045222.857647:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873746560 00000100:00100000:3.0:1784045222.857650:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873746560 00000100:00100000:3.0:1784045222.857663:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045222.857670:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6488:x1870706873746432:12345-0@lo:104: 00010000:00010000:3.0:1784045222.857681:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c93e79200/0x5475624df454c2ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c2f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.857736:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784045222.857742:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6488:x1870706873746432:12345-0@lo:104: Request processed in 73us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045222.857759:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045222.857782:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784045222.857798:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6488:x1870706873746560:12345-0@lo:104: 00010000:00010000:3.0:1784045222.857806:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c93e78000/0x5475624df454c2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c2cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.857849:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784045222.857855:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6488:x1870706873746560:12345-0@lo:104: Request processed in 67us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045222.857861:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1784045222.857896:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045222.857902:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c93e79200/0x5475624df454c2ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c2f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.857909:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e79200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045222.857913:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c93e79200/0x5475624df454c2ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c2f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.857933:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c93e79200/0x5475624df454c2ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c2f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045222.857941:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c93e79200/0x5475624df454c2ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c2f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045222.857947:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045222.857980:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c93e79200/0x5475624df454c2ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.857987:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045222.858003:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c93e79200/0x5475624df454c2ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.858010:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c93e79200/0x5475624df454c2ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2f5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.858023:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045222.858027:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c93e78000/0x5475624df454c2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c2cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.858033:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045222.858036:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c93e78000/0x5475624df454c2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c2cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.858043:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c93e78000/0x5475624df454c2c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c2cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045222.858048:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c93e78000/0x5475624df454c2c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c2cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045222.858060:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045222.858074:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c93e78000/0x5475624df454c2c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.858080:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045222.858096:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c93e78000/0x5475624df454c2c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.858102:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c93e78000/0x5475624df454c2c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2cb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.858112:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045222.858114:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045222.858115:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045222.858128:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873746816:0@lo:103: 00000100:00100000:3.0:1784045222.858156:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045222.858198:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873746944:0@lo:103: 00000100:00100000:3.0:1784045222.858220:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045222.858254:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873746816 00000100:00100000:3.0:1784045222.858259:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873746816 00010000:00010000:3.0:1784045222.858275:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc21fda00/0x5475624df454c2f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c2ee expref: 19 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045222.858295:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873746944 00000100:00100000:3.0:1784045222.858298:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873746944 00010000:00010000:3.0:1784045222.858308:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c93e78e00/0x5475624df454c2cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c2c4 expref: 20 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045222.858321:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045222.858335:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:3624:x1870706873746816:12345-0@lo:103: 00010000:00010000:3.0:1784045222.858359:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045222.858366:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc21fda00/0x5475624df454c2f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c2ee expref: 20 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.858386:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc21fda00/0x5475624df454c2f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c2ee expref: 20 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.858402:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045222.858431:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:3624:x1870706873746816:12345-0@lo:103: Request processed in 98us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045222.858438:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045222.858482:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784045222.858489:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:3625:x1870706873746944:12345-0@lo:103: 00010000:00010000:3.0:1784045222.858508:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045222.858513:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c93e78e00/0x5475624df454c2cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c2c4 expref: 19 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.858522:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c93e78e00/0x5475624df454c2cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c2c4 expref: 19 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.858532:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045222.858559:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:3625:x1870706873746944:12345-0@lo:103: Request processed in 70us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045222.858566:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784045222.858600:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873746944:0@lo:103: 00000100:00100000:3.0:1784045222.858622:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873746816:0@lo:103: 00010000:00010000:1.0:1784045222.858918:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045222.859292:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c93e78800/0x5475624df454c277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c270 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.859305:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c93e78800/0x5475624df454c277 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c270 expref: 18 pid: 6488 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045222.859315:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873747072:0@lo:104: 00000100:00100000:0.0:1784045222.859361:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784045222.859389:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c93e78600/0x5475624df454c200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c1f9 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.859396:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c93e78600/0x5475624df454c200 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c1f9 expref: 18 pid: 6490 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045222.859403:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873747200:0@lo:104: 00000100:00100000:0.0:1784045222.859422:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045222.859431:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc1268000 going to sleep for 11 seconds 00010000:00010000:0.0:1784045222.859469:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc21fda00/0x5475624df454c2f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c2ee expref: 18 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045222.859481:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873746432:0@lo:104: 00010000:00010000:0.0:1784045222.859500:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c93e78e00/0x5475624df454c2cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c2c4 expref: 17 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045222.859521:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915b9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873746560:0@lo:104: 00000100:00100000:3.0:1784045222.859701:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873746688 00000100:00100000:3.0:1784045222.859713:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873746688 00000100:00100000:3.0:1784045222.859741:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873747072 00000100:00100000:3.0:1784045222.859744:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873747072 00000100:00100000:3.0:1784045222.860031:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873747200 00000100:00100000:3.0:1784045222.860034:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873747200 00000100:00100000:3.0:1784045222.860050:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784045222.860057:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:6488:x1870706873746688:12345-0@lo:104: 00010000:00010000:3.0:1784045222.860069:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c2af expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.860143:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784045222.860148:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:6488:x1870706873746688:12345-0@lo:104: Request processed in 93us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045222.860156:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784045222.860172:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784045222.860177:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6488:x1870706873747072:12345-0@lo:104: 00010000:00010000:3.0:1784045222.860186:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c277 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.860234:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784045222.860239:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6488:x1870706873747072:12345-0@lo:104: Request processed in 62us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045222.860246:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784045222.860258:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784045222.860264:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6488:x1870706873747200:12345-0@lo:104: 00010000:00010000:3.0:1784045222.860271:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c915aac00/0x5475624df454c1f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c200 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.860301:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784045222.860312:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6488:x1870706873747200:12345-0@lo:104: Request processed in 48us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045222.860318:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1784045222.860336:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784045222.860506:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045222.860513:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c277 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.860521:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2170000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045222.860525:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c277 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.860534:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c277 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045222.860541:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c277 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045222.860558:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045222.860588:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c270 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c277 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.860594:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045222.860611:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c270 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c277 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.860619:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c270 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c277 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.860633:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045222.860636:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c915aac00/0x5475624df454c1f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c200 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.860642:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aac00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045222.860646:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c915aac00/0x5475624df454c1f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c200 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.860652:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915aac00/0x5475624df454c1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c200 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045222.860658:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915aac00/0x5475624df454c1f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c200 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045222.860664:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045222.860676:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c915aac00/0x5475624df454c1f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c200 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.860682:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045222.860698:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c915aac00/0x5475624df454c1f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c200 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.860704:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915aac00/0x5475624df454c1f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c200 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.860714:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045222.860715:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045222.860717:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045222.861009:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873747328:0@lo:103: 00000100:00100000:1.0:1784045222.861050:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784045222.861095:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045222.861128:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c2af expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.861137:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fc400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045222.861140:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c2af expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.861148:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c2af expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045222.861155:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c2af expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045222.861160:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045222.861177:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c2a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2af expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.861183:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045222.861189:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c2a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2af expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.861196:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c2a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2af expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.861218:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045222.861220:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045222.861221:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045222.861238:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873747584:0@lo:103: 00000100:00100000:3.0:1784045222.861264:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045222.861323:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045222.861329:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873747456:0@lo:103: 00000100:00100000:3.0:1784045222.861363:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045222.861468:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873746688:0@lo:104: 00000100:00100000:0.0:1784045222.861479:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873747072:0@lo:104: 00000100:00100000:0.0:1784045222.861486:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873747200:0@lo:104: 00010000:00010000:0.0:1784045222.861525:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045222.862276:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873747328 00000100:00100000:1.0:1784045222.862283:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873747328 00010000:00010000:1.0:1784045222.862333:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c93e78800/0x5475624df454c277 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c270 expref: 17 pid: 6488 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045222.862536:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873747584 00000100:00100000:0.0:1784045222.862540:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873747584 00010000:00010000:0.0:1784045222.862556:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c915ab000/0x5475624df454c2af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c2a8 expref: 18 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045222.862569:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873747456 00000100:00100000:0.0:1784045222.862571:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873747456 00010000:00010000:0.0:1784045222.862580:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c93e78600/0x5475624df454c200 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c1f9 expref: 19 pid: 6490 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045222.862593:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784045222.862599:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:3626:x1870706873747328:12345-0@lo:103: 00010000:00010000:0.0:1784045222.862612:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045222.862617:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c93e78800/0x5475624df454c277 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c270 expref: 19 pid: 6488 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.862626:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c93e78800/0x5475624df454c277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c270 expref: 19 pid: 6488 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.862641:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c93e78800/0x5475624df454c277 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c270 expref: 19 pid: 6488 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.862664:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045222.862723:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:3626:x1870706873747328:12345-0@lo:103: Request processed in 123us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045222.862730:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784045222.862761:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784045222.863040:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873747328:0@lo:103: 00000100:00100000:0.0:1784045222.863095:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:3624:x1870706873747584:12345-0@lo:103: 00010000:00010000:0.0:1784045222.863105:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045222.863110:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c915ab000/0x5475624df454c2af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c2a8 expref: 17 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863119:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c915ab000/0x5475624df454c2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c2a8 expref: 17 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863130:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915ab000/0x5475624df454c2af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c2a8 expref: 17 pid: 6489 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863138:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045222.863177:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:3624:x1870706873747584:12345-0@lo:103: Request processed in 85us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045222.863183:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784045222.863198:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045222.863204:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:3624:x1870706873747456:12345-0@lo:103: 00010000:00010000:0.0:1784045222.863212:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045222.863216:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c93e78600/0x5475624df454c200 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c1f9 expref: 15 pid: 6490 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863224:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c93e78600/0x5475624df454c200 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c1f9 expref: 15 pid: 6490 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863241:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c93e78600/0x5475624df454c200 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c1f9 expref: 15 pid: 6490 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863253:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863261:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863275:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863282:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863288:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863295:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863300:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915ab600 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:0.0:1784045222.863304:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863312:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863326:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045222.863515:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873747584:0@lo:103: 00010000:00010000:0.0:1784045222.863581:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045222.863609:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:3624:x1870706873747456:12345-0@lo:103: Request processed in 405us (2245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045222.863616:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1784045222.863659:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863667:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045222.863674:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915ab600/0x5475624df454c334 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784045222.863686:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1784045222.864022:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873747456:0@lo:103: 00010000:00010000:1.0:1784045222.867673:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045222.882535:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+13:8405:x1870706873746304:12345-0@lo:253: Request processed in 37037us (37277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045222.882555:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784045222.882641:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873746304:0@lo:253: 10000000:01000000:3.0:1784045222.882663:0:8405:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784045222.882667:0:8405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784045222.882669:0:8405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784045222.882670:0:8405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045222.882671:0:8405:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1784045222.882673:0:8405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045222.882675:0:8405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045222.882676:0:8405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045222.882678:0:8405:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784045222.882679:0:8405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045222.882681:0:8405:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784045222.882708:0:8405:0:(tgt_mount.c:101:server_register_mount()) register mount ffff939cc10ba000 from lustre-OST0000 10000000:01000000:3.0:1784045222.882743:0:8405:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1784045222.882746:0:8405:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784045222.882754:0:8405:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff939c901d3380 local copy 10000000:01000000:3.0:1784045222.882758:0:8405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784045222.883083:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.883094:0:8405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.883103:0:8405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045222.883124:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873747712:0@lo:101: 00000100:00100000:3.0:1784045222.883200:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045222.883299:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92cbb240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045222.886164:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873747712 00000100:00100000:1.0:1784045222.886178:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873747712 00000100:00100000:1.0:1784045222.887555:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784045222.887575:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+13:8405:x1870706873747712:12345-0@lo:101: 00010000:00010000:1.0:1784045222.887591:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045222.887610:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106f200/0x5475624df454c342 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c33b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.887638:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106f200/0x5475624df454c342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c33b expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.887651:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106f200/0x5475624df454c342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c33b expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.887678:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106f200, rc 0) 00000100:00100000:1.0:1784045222.887763:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:8405:x1870706873747712:12345-0@lo:101: Request processed in 196us (4561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045222.887772:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784045222.887881:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873747712:0@lo:101: 00010000:00010000:3.0:1784045222.887901:0:8405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5475624df454c342 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.887911:0:8405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5475624df454c342 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045222.888044:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873747840:0@lo:501: 00000100:00100000:3.0:1784045222.888092:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045222.891392:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92cbb240 going to sleep for 11 seconds 00000100:00100000:2.0:1784045222.896315:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873747840 00000100:00100000:2.0:1784045222.896330:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873747840 00000100:00100000:2.0:1784045222.896392:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784045222.896402:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:8405:x1870706873747840:12345-0@lo:501: 00000100:00100000:2.0:1784045222.896567:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:8405:x1870706873747840:12345-0@lo:501: Request processed in 166us (8474us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045222.896575:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784045222.897688:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873747840:0@lo:501: 10000000:01000000:3.0:1784045222.897729:0:8405:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784045222.897783:0:8405:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784045222.897794:0:8405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5475624df454c342 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.897806:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5475624df454c342 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.897813:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5475624df454c342 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.897844:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784045222.897884:0:8405:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff939cc10ba000 10000000:01000000:3.0:1784045222.897891:0:8405:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784045222.897898:0:8405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784045222.897917:0:8405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784045222.897922:0:8405:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784045222.897926:0:8405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784045222.897969:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.897979:0:8405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.897991:0:8405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045222.898016:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873747968:0@lo:101: 00000100:00100000:3.0:1784045222.898088:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045222.898100:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045222.898112:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5475624df454c342 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045222.898124:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1784045222.898129:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5475624df454c342 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045222.898139:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2240 going to sleep for 11 seconds 00010000:00010000:2.0:1784045222.898139:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5475624df454c342 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045222.898156:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5475624df454c342 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045222.898163:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784045222.898199:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5475624df454c342 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045222.898206:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045222.898245:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5475624df454c342 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045222.898253:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c33b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5475624df454c342 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045222.898285:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045222.898287:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045222.898289:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045222.898298:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045222.898317:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873748096:0@lo:103: 00000100:00100000:2.0:1784045222.898370:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045222.898411:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873747968 00000100:00100000:2.0:1784045222.898417:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873747968 00000100:00100000:2.0:1784045222.898475:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784045222.898483:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:8405:x1870706873747968:12345-0@lo:101: 00010000:00010000:2.0:1784045222.898506:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045222.898522:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc21fc200/0x5475624df454c350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c349 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045222.898547:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc21fc200/0x5475624df454c350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c349 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045222.898558:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc21fc200/0x5475624df454c350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c349 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045222.898567:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fc200, rc 0) 00000100:00100000:2.0:1784045222.898603:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8405:x1870706873747968:12345-0@lo:101: Request processed in 121us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045222.898609:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784045222.898711:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873748096 00000100:00100000:3.0:1784045222.898715:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873748096 00000100:00100000:3.0:1784045222.898756:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045222.898763:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:3626:x1870706873748096:12345-0@lo:103: 00010000:00010000:3.0:1784045222.898773:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045222.898785:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106f200/0x5475624df454c342 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c33b expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.898804:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045222.898834:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:3626:x1870706873748096:12345-0@lo:103: Request processed in 72us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045222.898839:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045222.898870:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873748096:0@lo:103: 00000100:00100000:3.0:1784045222.898900:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873747968:0@lo:101: 00010000:00010000:3.0:1784045222.898923:0:8405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c350 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.898945:0:8405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c350 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045222.899035:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748224:0@lo:501: 00000100:00100000:3.0:1784045222.899061:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045222.899082:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1784045222.899272:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873748224 00000100:00100000:2.0:1784045222.899277:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873748224 00000100:00100000:2.0:1784045222.899297:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784045222.899304:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:8405:x1870706873748224:12345-0@lo:501: 00000100:00100000:2.0:1784045222.899437:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:8405:x1870706873748224:12345-0@lo:501: Request processed in 133us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045222.899471:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784045222.899588:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748224:0@lo:501: 00000100:00100000:3.0:1784045222.899618:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748352:0@lo:503: 00000100:00100000:3.0:1784045222.899660:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045222.899686:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1784045222.899724:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873748352 00000100:00100000:2.0:1784045222.899728:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873748352 00000100:00100000:2.0:1784045222.899745:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784045222.899750:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:8405:x1870706873748352:12345-0@lo:503: 00000100:00100000:2.0:1784045222.899843:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:8405:x1870706873748352:12345-0@lo:503: Request processed in 92us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045222.899850:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784045222.900036:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748352:0@lo:503: 00000040:00080000:3.0:1784045222.900276:0:8405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784045222.900334:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748480:0@lo:502: 00000100:00100000:3.0:1784045222.900371:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045222.900395:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8558de40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045222.900886:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873748480 00000100:00100000:2.0:1784045222.900892:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873748480 00000100:00100000:2.0:1784045222.900917:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784045222.900924:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:8405:x1870706873748480:12345-0@lo:502: 00000100:00100000:2.0:1784045222.901177:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:8405:x1870706873748480:12345-0@lo:502: Request processed in 252us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045222.901184:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784045222.901271:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748480:0@lo:502: 00000040:00080000:3.0:1784045222.901533:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784045222.901563:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1784045222.901578:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1784045222.901591:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1784045222.901607:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1784045222.901634:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1784045222.903145:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748608:0@lo:502: 00000100:00100000:3.0:1784045222.903228:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045222.903270:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8558de40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045222.903351:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873748608 00000100:00100000:2.0:1784045222.903358:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873748608 00000100:00100000:2.0:1784045222.903400:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784045222.903410:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:8405:x1870706873748608:12345-0@lo:502: 00000100:00100000:2.0:1784045222.903560:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:8405:x1870706873748608:12345-0@lo:502: Request processed in 150us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045222.903568:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784045222.903727:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748608:0@lo:502: 00000040:00080000:3.0:1784045222.903863:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784045222.903877:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1784045222.910403:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784045222.910414:0:8428:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1784045222.910422:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045222.910424:0:8428:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784045222.910430:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784045222.910502:0:8428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff939b819b0000) 00000020:00000080:3.0:1784045222.910528:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784045222.910536:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784045222.910615:0:8428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939cc10ba000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784045222.910624:0:8428:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784045222.910631:0:8428:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5475624df454c35e 00010000:00010000:3.0:1784045222.920932:0:8428:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1784045222.921299:0:8428:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1784045222.926643:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784045222.926976:0:8428:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1784045222.931708:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1784045222.931929:0:8428:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1784045222.944254:0:8428:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1784045222.949134:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784045222.949146:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045222.949152:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045222.949155:0:8428:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784045222.949158:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045222.949163:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045222.949164:0:8428:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784045222.949167:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784045222.949169:0:8428:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784045222.949197:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045222.949200:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045222.949202:0:8428:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784045222.949205:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1784045222.950588:0:8405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1784045222.950623:0:8405:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784045222.950687:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c350 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.950698:0:8405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c350 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045222.950706:0:8405:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939cc10ba000 from 1 10000000:01000000:3.0:1784045222.950708:0:8405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045222.950765:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.950774:0:8405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.950785:0:8405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045222.951897:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748736:0@lo:101: 00000100:00100000:3.0:1784045222.951981:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045222.952073:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2240 going to sleep for 11 seconds 00000100:00100000:3.0:1784045222.957335:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873748736 00000100:00100000:3.0:1784045222.957350:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873748736 00000100:00100000:3.0:1784045222.957463:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784045222.957474:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:8405:x1870706873748736:12345-0@lo:101: 00010000:00010000:3.0:1784045222.957499:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045222.957516:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc2171c00/0x5475624df454c36c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c365 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.957544:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc2171c00/0x5475624df454c36c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c365 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.957556:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc2171c00/0x5475624df454c36c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c365 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045222.957565:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171c00, rc 0) 00000100:00100000:3.0:1784045222.957634:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8405:x1870706873748736:12345-0@lo:101: Request processed in 163us (5653us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045222.957641:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784045222.957765:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748736:0@lo:101: 00010000:00010000:2.0:1784045222.957782:0:8405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c36c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045222.958666:0:8405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c36c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045222.958782:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748864:0@lo:501: 00000100:00100000:2.0:1784045222.958892:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045222.959376:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045222.959508:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873748864 00000100:00100000:1.0:1784045222.959514:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873748864 00000100:00100000:1.0:1784045222.959549:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784045222.959555:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8405:x1870706873748864:12345-0@lo:501: 00000100:00100000:1.0:1784045222.959676:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8405:x1870706873748864:12345-0@lo:501: Request processed in 120us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045222.959683:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784045222.959906:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748864:0@lo:501: 00000100:00100000:2.0:1784045222.959960:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748992:0@lo:503: 00000100:00100000:2.0:1784045222.960008:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045222.960028:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045222.960553:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873748992 00000100:00100000:1.0:1784045222.960561:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873748992 00000100:00100000:1.0:1784045222.960584:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784045222.960591:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8405:x1870706873748992:12345-0@lo:503: 00000100:00100000:1.0:1784045222.960687:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8405:x1870706873748992:12345-0@lo:503: Request processed in 96us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045222.960694:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784045222.960865:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873748992:0@lo:503: 00000040:00080000:2.0:1784045222.961113:0:8405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784045222.961196:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749120:0@lo:502: 00000100:00100000:2.0:1784045222.961238:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045222.961272:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045222.963859:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873749120 00000100:00100000:1.0:1784045222.963875:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873749120 00000100:00100000:1.0:1784045222.963944:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784045222.963955:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8405:x1870706873749120:12345-0@lo:502: 00000100:00100000:1.0:1784045222.964148:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8405:x1870706873749120:12345-0@lo:502: Request processed in 194us (2908us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045222.964155:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784045222.964350:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749120:0@lo:502: 00000040:00080000:2.0:1784045222.964630:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1784045222.964680:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1784045222.964713:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749248:0@lo:502: 00000100:00100000:2.0:1784045222.964758:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045222.964869:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045222.964988:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873749248 00000100:00100000:1.0:1784045222.965000:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873749248 00000100:00100000:1.0:1784045222.965024:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784045222.965030:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8405:x1870706873749248:12345-0@lo:502: 00000100:00100000:1.0:1784045222.965125:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8405:x1870706873749248:12345-0@lo:502: Request processed in 94us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045222.965132:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784045222.965361:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749248:0@lo:502: 00000040:00080000:2.0:1784045222.965404:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1784045222.965413:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1784045222.965918:0:8432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045222.965939:0:8432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045222.965942:0:8432:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784045222.965948:0:8432:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939cc10ba000 00000020:00000080:1.0:1784045222.965951:0:8432:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784045222.965963:0:8432:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045222.965966:0:8432:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045222.965967:0:8432:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784045222.965969:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1784045222.971558:0:8405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784045222.971605:0:8405:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784045222.971625:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c36c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045222.971639:0:8405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c36c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045222.971725:0:8405:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784045222.971729:0:8405:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff939cc10ba000 10000000:01000000:2.0:1784045222.971733:0:8405:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff939cc10ba000 10000000:01000000:2.0:1784045222.971737:0:8405:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784045222.971743:0:8405:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939cc10ba000 from 1 10000000:01000000:2.0:1784045222.971746:0:8405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784045222.971784:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045222.971818:0:8405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045222.971829:0:8405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045222.971853:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749376:0@lo:101: 00000100:00100000:2.0:1784045222.971913:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045222.971955:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c83afe540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045222.975002:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873749376 00000100:00100000:1.0:1784045222.975015:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873749376 00000100:00100000:1.0:1784045222.975075:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784045222.975085:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8405:x1870706873749376:12345-0@lo:101: 00010000:00010000:1.0:1784045222.975101:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045222.975119:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106ea00/0x5475624df454c37a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c373 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.975145:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106ea00/0x5475624df454c37a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c373 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.975155:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106ea00/0x5475624df454c37a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c373 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045222.975164:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106ea00, rc 0) 00000100:00100000:1.0:1784045222.975251:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:8405:x1870706873749376:12345-0@lo:101: Request processed in 167us (3337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045222.975258:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784045222.975391:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749376:0@lo:101: 00010000:00010000:2.0:1784045222.975409:0:8405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c37a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045222.975419:0:8405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c37a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045222.975615:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749504:0@lo:501: 00000100:00100000:3.0:1784045222.975658:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045222.975685:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873749504 00000100:00100000:3.0:1784045222.975690:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92ca1300 going to sleep for 11 seconds 00000100:00100000:0.0:1784045222.975692:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873749504 00000100:00100000:0.0:1784045222.975729:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784045222.975736:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:8405:x1870706873749504:12345-0@lo:501: 00000100:00100000:0.0:1784045222.975914:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:8405:x1870706873749504:12345-0@lo:501: Request processed in 178us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045222.975922:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784045222.975944:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749504:0@lo:501: 00000100:00100000:3.0:1784045222.975976:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749632:0@lo:503: 00000100:00100000:3.0:1784045222.976019:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045222.976041:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92ca1300 going to sleep for 11 seconds 00000100:00100000:1.0:1784045222.976066:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873749632 00000100:00100000:1.0:1784045222.976071:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873749632 00000100:00100000:1.0:1784045222.976097:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784045222.976104:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:8405:x1870706873749632:12345-0@lo:503: 00000100:00100000:1.0:1784045222.976189:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:8405:x1870706873749632:12345-0@lo:503: Request processed in 86us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045222.976197:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784045222.976223:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749632:0@lo:503: 00000040:00080000:3.0:1784045222.976574:0:8405:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784045222.976634:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749760:0@lo:502: 00000100:00100000:3.0:1784045222.976672:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045222.976699:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92ca1300 going to sleep for 11 seconds 00000100:00100000:2.0:1784045222.976721:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873749760 00000100:00100000:2.0:1784045222.976727:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873749760 00000100:00100000:2.0:1784045222.976761:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784045222.976768:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:8405:x1870706873749760:12345-0@lo:502: 00000100:00100000:2.0:1784045222.976924:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:8405:x1870706873749760:12345-0@lo:502: Request processed in 156us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045222.976943:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784045222.977015:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749760:0@lo:502: 00000040:00080000:1.0:1784045222.977231:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1784045222.977261:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1784045222.977278:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1784045222.977291:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1784045222.977303:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1784045222.977316:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1784045222.977328:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1784045222.977342:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1784045222.977355:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1784045222.977368:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1784045222.977380:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1784045222.977391:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1784045222.977403:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1784045222.977416:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1784045222.977429:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1784045222.977441:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1784045222.977517:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1784045222.977546:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1784045222.977561:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1784045222.978958:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1784045222.979005:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1784045222.979019:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1784045222.979031:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1784045222.979044:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1784045222.979056:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1784045222.979070:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1784045222.979083:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1784045222.979094:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1784045222.979106:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1784045222.979119:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1784045222.979133:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1784045222.979145:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1784045222.979158:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1784045222.979192:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1784045222.979208:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1784045222.979223:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1784045222.979234:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1784045222.979275:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749888:0@lo:502: 00000100:00100000:1.0:1784045222.979346:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045222.980196:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c87df7300 going to sleep for 11 seconds 00000100:00100000:2.0:1784045222.990269:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873749888 00000100:00100000:2.0:1784045222.990283:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873749888 00000100:00100000:3.0:1784045222.990481:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784045222.990507:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:8405:x1870706873749888:12345-0@lo:502: 00000100:00100000:3.0:1784045222.990922:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:8405:x1870706873749888:12345-0@lo:502: Request processed in 417us (11575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045222.990931:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784045222.991372:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873749888:0@lo:502: 00000040:00080000:1.0:1784045222.991483:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1784045222.991506:0:8405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1784045222.993080:0:8433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784045222.993096:0:8433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff939b819b4d40) 00000020:00000080:3.0:1784045222.993119:0:8433:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1784045222.993307:0:8433:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939cc10ba000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784045222.993312:0:8433:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939cc10ba000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784045222.993315:0:8433:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939cc10ba000 3 00010000:00080000:3.0:1784045222.993345:0:8433:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939b81989000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1784045222.995264:0:8433:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1784045222.995387:0:8433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1784045222.995436:0:8433:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784045222.995476:0:8433:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5475624df454c388 00000100:00080000:3.0:1784045222.995487:0:8433:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784045222.995503:0:8433:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff939b81989000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045222.995540:0:8433:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939c91562680 x1870706873750016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045222.995564:0:8433:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784045222.995699:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1870706873750016:0@lo:38: 00000100:00100000:1.0:1784045222.995780:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045222.996732:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873750144:0@lo:400: 00000100:00100000:1.0:1784045222.996779:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045222.996815:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045222.996821:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873750528:0@lo:400: 00000100:00100000:1.0:1784045222.996861:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045222.996896:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873750400:0@lo:400: 00000100:00100000:1.0:1784045222.996918:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045222.996935:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045222.996940:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873750272:0@lo:400: 00000100:00100000:1.0:1784045222.996961:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045222.996990:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873750016 00000100:00100000:1.0:1784045222.996997:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873750016 00000100:00100000:1.0:1784045222.997018:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873750144 00000100:00100000:1.0:1784045222.997021:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873750144 00000100:00100000:1.0:1784045222.997040:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873750400 00000100:00100000:1.0:1784045222.997042:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873750400 00000100:00100000:1.0:1784045222.997058:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784045222.997066:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873750144:12345-0@lo:400: 00000100:00100000:1.0:1784045222.997119:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873750144:12345-0@lo:400: Request processed in 53us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045222.997127:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784045222.997150:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784045222.997158:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873750400:12345-0@lo:400: 00000100:00100000:1.0:1784045222.997193:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873750400:12345-0@lo:400: Request processed in 36us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045222.997199:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784045222.997214:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045222.997220:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1870706873750016:12345-0@lo:38: 00010000:00080000:1.0:1784045222.997241:0:6498:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1784045222.997299:0:6498:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5475624df454c38f 00000004:00100000:1.0:1784045222.997317:0:6498:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784045222.997356:0:6498:0:(import.c:65:import_set_state_nolock()) ffff939c8fd28800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784045222.997402:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1870706873750016:12345-0@lo:38: Request processed in 181us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045222.997410:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045222.997435:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873750528 00000100:00100000:1.0:1784045222.997439:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873750528 00000100:00100000:1.0:1784045222.997488:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873750272 00000100:00100000:1.0:1784045222.997502:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873750272 00000100:00100000:1.0:1784045222.997518:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784045222.997525:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873750528:12345-0@lo:400: 00000100:00100000:1.0:1784045222.997562:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873750528:12345-0@lo:400: Request processed in 38us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045222.997569:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784045222.997587:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784045222.997596:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873750272:12345-0@lo:400: 00000100:00100000:1.0:1784045222.997628:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873750272:12345-0@lo:400: Request processed in 36us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045222.997634:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784045222.997678:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873750272:0@lo:400: 00010000:00080000:1.0:1784045222.997689:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939c915c0380 x1870706873750400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045222.997699:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873750400:0@lo:400: 00010000:00080000:1.0:1784045222.997731:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939c91562680 x1870706873750016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045222.997739:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784045222.997745:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1784045222.997760:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784045222.997764:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784045222.997767:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b81989000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784045222.997773:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1870706873750016:0@lo:38: 00000100:00100000:1.0:1784045222.997802:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873750528:0@lo:400: 00010000:00080000:1.0:1784045222.997814:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939c915c1500 x1870706873750144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045222.997823:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873750144:0@lo:400: 00000020:01000004:0.0:1784045222.998878:0:8433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1784045222.998895:0:8433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff939cb59d3380) 00000020:00000080:0.0:1784045222.998914:0:8433:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1784045223.000954:0:8433:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939cc10ba000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784045223.000962:0:8433:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939cc10ba000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784045223.000965:0:8433:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939cc10ba000 3 00010000:00080000:1.0:1784045223.001007:0:8433:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939c8fd28000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1784045223.005806:0:8433:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1784045223.005910:0:8433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1784045223.005961:0:8433:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784045223.005975:0:8433:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5475624df454c39d 00000100:00080000:1.0:1784045223.005985:0:8433:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784045223.005991:0:8433:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff939c8fd28000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1784045223.006036:0:8433:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939c915c1500 x1870706873750656/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784045223.006066:0:8433:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1784045223.006621:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1870706873750656:0@lo:38: 00000100:00100000:3.0:1784045223.006708:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045223.006877:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873750656 00000100:00100000:0.0:1784045223.006885:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873750656 00000100:00100000:0.0:1784045223.006920:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045223.006927:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1870706873750656:12345-0@lo:38: 00010000:00080000:0.0:1784045223.006964:0:6498:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1784045223.006996:0:6498:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5475624df454c3a4 00000004:00100000:0.0:1784045223.007010:0:6498:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784045223.007040:0:6498:0:(import.c:65:import_set_state_nolock()) ffff939b82180800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045223.007111:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1870706873750656:12345-0@lo:38: Request processed in 182us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045223.007119:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784045223.007212:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939c915c1500 x1870706873750656/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045223.007223:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784045223.007230:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1784045223.007243:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784045223.007247:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784045223.007250:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c8fd28000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784045223.007256:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1870706873750656:0@lo:38: 00000040:00080000:3.0:1784045223.007279:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1784045223.007351:0:8405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1784045223.007383:0:8405:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784045223.007398:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c37a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045223.007408:0:8405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c37a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784045223.007474:0:8405:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784045223.007477:0:8405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784045223.007478:0:8405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784045223.007480:0:8405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784045223.007481:0:8405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784045223.007483:0:8405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784045223.007484:0:8405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784045223.007486:0:8405:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784045223.007488:0:8405:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784045223.007499:0:8405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784045223.007501:0:8405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784045223.007505:0:8405:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1784045223.007508:0:8405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784045223.007510:0:8405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784045223.007511:0:8405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784045223.007512:0:8405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784045223.007513:0:8405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784045223.007514:0:8405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784045223.007515:0:8405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784045223.007516:0:8405:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784045223.007517:0:8405:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784045223.007518:0:8405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784045223.007519:0:8405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784045223.007540:0:8405:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784045223.007553:0:8405:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873750784:0@lo:253: 00000100:00100000:1.0:1784045223.007594:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045223.007620:0:8405:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c87df79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045223.015846:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873750784 00000100:00100000:3.0:1784045223.015859:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873750784 00000100:00100000:3.0:1784045223.015927:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784045223.015937:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:8405:x1870706873750784:12345-0@lo:253: 20000000:01000000:3.0:1784045223.015972:0:6490:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784045223.015989:0:6490:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784045223.037344:0:6490:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784045223.037366:0:6490:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1784045223.038232:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:8405:x1870706873750784:12345-0@lo:253: Request processed in 22291us (30630us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045223.038245:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 20000000:01000000:0.0:1784045223.038338:0:6512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784045223.038344:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784045223.038363:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045223.038380:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c93e78400/0x5475624df454c2a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c29a expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045223.038387:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c915abe00/0x5475624df454c2bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c2b6 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045223.038395:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045223.038430:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c915abe00/0x5475624df454c2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c2b6 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045223.038466:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c915abe00/0x5475624df454c2bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c2b6 expref: 15 pid: 6489 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045223.038480:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873750912:0@lo:104: 00000100:00100000:0.0:1784045223.038529:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784045223.038587:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c93e78400/0x5475624df454c2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c29a expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045223.038596:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c93e78400/0x5475624df454c2a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c29a expref: 15 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045223.038605:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873751040:0@lo:104: 00000100:00100000:0.0:1784045223.038625:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93619c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045223.038695:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784045223.038711:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045223.038738:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873750912 00000100:00100000:2.0:1784045223.038745:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873750912 00000100:00100000:2.0:1784045223.038786:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873751040 00000100:00100000:2.0:1784045223.038789:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873751040 00000100:00100000:2.0:1784045223.038802:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045223.038809:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88232050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6512:x1870706873750912:12345-0@lo:104: 00010000:00010000:2.0:1784045223.038819:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c2bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.038867:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784045223.038873:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88232050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6512:x1870706873750912:12345-0@lo:104: Request processed in 65us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045223.038879:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045223.038910:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045223.038917:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6512:x1870706873751040:12345-0@lo:104: 00010000:00010000:2.0:1784045223.038924:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc2171400/0x5475624df454c29a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c2a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.038955:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784045223.038960:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6512:x1870706873751040:12345-0@lo:104: Request processed in 45us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045223.038965:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045223.038995:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873750912:0@lo:104: 00000100:00100000:2.0:1784045223.039005:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873751040:0@lo:104: 00010000:00010000:2.0:1784045223.039030:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.039045:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784045223.039050:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c2bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.039057:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fd800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1784045223.039062:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c2bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.039070:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c2b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c2bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045223.039076:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c2b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c2bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045223.039082:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784045223.039108:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c2b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.039114:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045223.039133:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c2b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.039140:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c2b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2bd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.039153:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045223.039156:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc2171400/0x5475624df454c29a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c2a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.039175:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1784045223.039178:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171400/0x5475624df454c29a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c2a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.039185:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc2171400/0x5475624df454c29a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c2a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045223.039190:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171400/0x5475624df454c29a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c2a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045223.039195:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784045223.039209:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc2171400/0x5475624df454c29a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.039215:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045223.039229:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc2171400/0x5475624df454c29a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.039236:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc2171400/0x5475624df454c29a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c2a1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.039248:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045223.039250:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045223.039252:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045223.039258:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045223.039269:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873751168:0@lo:103: 00000100:00100000:2.0:1784045223.039297:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045223.039336:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873751296:0@lo:103: 00000100:00100000:2.0:1784045223.039368:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045223.039403:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873751168 00000100:00100000:2.0:1784045223.039407:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873751168 00010000:00010000:2.0:1784045223.039423:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c915abe00/0x5475624df454c2bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c2b6 expref: 16 pid: 6489 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045223.039473:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873751296 00000100:00100000:2.0:1784045223.039477:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873751296 00010000:00010000:2.0:1784045223.040378:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c93e78400/0x5475624df454c2a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c29a expref: 17 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045223.040404:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045223.040412:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:3626:x1870706873751168:12345-0@lo:103: 00010000:00010000:2.0:1784045223.040425:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045223.040430:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c915abe00/0x5475624df454c2bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c2b6 expref: 17 pid: 6489 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.040441:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c915abe00/0x5475624df454c2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c2b6 expref: 17 pid: 6489 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045223.040539:0:8405:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:8405:1870706873750784:0@lo:253: 10000000:01000000:0.0:1784045223.040553:0:8405:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784045223.040556:0:8405:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784045223.040558:0:8405:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784045223.040559:0:8405:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045223.040560:0:8405:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045223.040562:0:8405:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045223.040563:0:8405:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045223.040565:0:8405:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045223.040566:0:8405:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784045223.040568:0:8405:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784045223.040570:0:8405:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045223.040572:0:8405:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784045223.040583:0:8405:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1784045223.040854:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915abe00/0x5475624df454c2bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c2b6 expref: 17 pid: 6489 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.040869:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045223.040935:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:3626:x1870706873751168:12345-0@lo:103: Request processed in 524us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045223.040942:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045223.040964:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045223.040971:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:3623:x1870706873751296:12345-0@lo:103: 00010000:00010000:2.0:1784045223.040980:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045223.040996:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c93e78400/0x5475624df454c2a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c29a expref: 15 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.041006:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c93e78400/0x5475624df454c2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c29a expref: 15 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.041016:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c93e78400/0x5475624df454c2a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c29a expref: 15 pid: 6488 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.041029:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.041038:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784045223.041054:0:6483:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003759372s 00010000:00010000:2.0:1784045223.041059:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.041066:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.041073:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.041081:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.041087:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915ab600 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045223.041092:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.041099:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.041121:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.041132:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045223.041162:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:3623:x1870706873751296:12345-0@lo:103: Request processed in 192us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045223.041168:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1784045223.041201:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.041210:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045223.041216:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915ab600/0x5475624df454c3ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045223.041247:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873751296:0@lo:103: 00000100:00100000:2.0:1784045223.041271:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873751168:0@lo:103: 00080000:10000000:1.0:1784045223.057076:0:8405:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1784045223.057243:0:8405:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1784045223.057427:0:8405:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1784045223.057621:0:8405:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1784045223.057812:0:8405:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1784045223.058021:0:8405:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:3.0:1784045223.059671:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045223.059693:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873751424:0@lo:41: 00000100:00100000:3.0:1784045223.059766:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045223.059814:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873751424 00000100:00100000:3.0:1784045223.059821:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873751424 00000100:00100000:3.0:1784045223.059867:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784045223.059875:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873751424:12345-0@lo:41: 00000004:00000024:3.0:1784045223.059906:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1784045223.059949:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873751424:12345-0@lo:41: Request processed in 74us (183us total) trans 0 rc 0/0 00000001:00000004:1.0:1784045223.063297:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1784045223.065597:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873751424:0@lo:41: 00000100:00100000:3.0:1784045223.066555:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00002000:00080000:1.0:1784045223.078043:0:8405:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1784045223.078051:0:8405:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1784045223.078093:0:8405:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784045223.078137:0:8405:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784045223.078160:0:8405:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1784045223.078180:0:8405:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1784045223.078931:0:8405:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784045223.079093:0:8405:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1784045223.896315:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784045223.965366:0:8489:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784045223.965712:0:8489:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784045224.603896:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873751552:0@lo:41: 00000100:00100000:1.0:1784045224.603961:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045224.604302:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873751552 00000100:00100000:0.0:1784045224.604310:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873751552 00000100:00100000:0.0:1784045224.604369:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784045224.604378:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873751552:12345-0@lo:41: 00000004:00000024:0.0:1784045224.604411:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1784045224.604475:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873751552:12345-0@lo:41: Request processed in 98us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045224.604493:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784045224.605029:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873751552:0@lo:41: 00010000:00010000:2.0:1784045224.915592:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045225.946828:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045226.963791:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784045227.162723:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784045227.162730:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939c9157c000 from 30 10000000:01000000:2.0:1784045227.162735:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784045227.162782:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.162793:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.162812:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045227.162835:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873751680:0@lo:101: 00000100:00100000:2.0:1784045227.162898:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.162947:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11e6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045227.163973:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873751680 00000100:00100000:3.0:1784045227.163983:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873751680 00000100:00100000:3.0:1784045227.164065:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784045227.164073:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:6493:x1870706873751680:12345-0@lo:101: 00010000:00010000:3.0:1784045227.164087:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045227.164102:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc2170200/0x5475624df454c3b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c3b2 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045227.164126:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc2170200/0x5475624df454c3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c3b2 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045227.164137:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc2170200/0x5475624df454c3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c3b2 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045227.164146:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2170200, rc 0) 00000100:00100000:3.0:1784045227.164203:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873751680:12345-0@lo:101: Request processed in 130us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045227.164210:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784045227.164435:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873751680:0@lo:101: 00010000:00010000:2.0:1784045227.164484:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c3b9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.164493:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c3b9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045227.164560:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873751808:0@lo:501: 00000100:00100000:2.0:1784045227.164593:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.164630:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11e6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.164631:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873751808 00000100:00100000:0.0:1784045227.164636:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873751808 00000100:00100000:0.0:1784045227.164660:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784045227.164667:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873751808:12345-0@lo:501: 00000100:00100000:0.0:1784045227.164801:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873751808:12345-0@lo:501: Request processed in 134us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.164808:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784045227.165531:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873751808:0@lo:501: 00000100:00100000:2.0:1784045227.165570:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873751936:0@lo:503: 00000100:00100000:2.0:1784045227.165628:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.165661:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11e6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.165712:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873751936 00000100:00100000:0.0:1784045227.165718:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873751936 00000100:00100000:0.0:1784045227.165753:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784045227.165760:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873751936:12345-0@lo:503: 00000100:00100000:0.0:1784045227.165863:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873751936:12345-0@lo:503: Request processed in 103us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.165870:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784045227.165909:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873751936:0@lo:503: 00000100:00100000:0.0:1784045227.166124:0:8640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8640:1870706873752064:0@lo:502: 00000100:00100000:0.0:1784045227.166155:0:8640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.166176:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873752064 00000100:00100000:0.0:1784045227.166180:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873752064 00000100:00100000:0.0:1784045227.166200:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784045227.166206:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8640:x1870706873752064:12345-0@lo:502: 00000100:00100000:0.0:1784045227.166284:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8640:x1870706873752064:12345-0@lo:502: Request processed in 77us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.166291:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784045227.166319:0:8640:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a4cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.166333:0:8640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8640:1870706873752064:0@lo:502: 00000100:00100000:0.0:1784045227.166380:0:8640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8640:1870706873752192:0@lo:502: 00000100:00100000:0.0:1784045227.166409:0:8640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.166431:0:8640:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a4cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045227.166461:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873752192 00000100:00100000:2.0:1784045227.166475:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873752192 00000100:00100000:2.0:1784045227.166505:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784045227.166511:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8640:x1870706873752192:12345-0@lo:502: 00000100:00100000:2.0:1784045227.166577:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:8640:x1870706873752192:12345-0@lo:502: Request processed in 66us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.166589:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784045227.167380:0:8640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8640:1870706873752192:0@lo:502: 00000040:00080000:0.0:1784045227.167409:0:8640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1784045227.168432:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1784045227.168493:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784045227.168505:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c3b9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.168516:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c3b9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045227.168526:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784045227.168529:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939c9157c000 from 5 10000000:01000000:2.0:1784045227.168531:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784045227.168567:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.168575:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.168584:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045227.168603:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873752320:0@lo:101: 00000100:00100000:2.0:1784045227.168660:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.168702:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11e6180 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.169892:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873752320 00000100:00100000:0.0:1784045227.169903:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873752320 00000100:00100000:0.0:1784045227.169953:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784045227.169963:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873752320:12345-0@lo:101: 00010000:00010000:0.0:1784045227.169977:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045227.169995:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915aa000/0x5475624df454c3c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c3c0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.170020:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915aa000/0x5475624df454c3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c3c0 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.170032:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915aa000/0x5475624df454c3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c3c0 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.170041:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aa000, rc 0) 00000100:00100000:0.0:1784045227.170426:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873752320:12345-0@lo:101: Request processed in 463us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.170434:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784045227.170530:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873752320:0@lo:101: 00010000:00010000:0.0:1784045227.170548:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c3c7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.170569:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c3c7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045227.170625:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873752448:0@lo:256: 00000100:00100000:0.0:1784045227.170663:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.170693:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a4c840 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.170708:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873752448 00000100:00100000:0.0:1784045227.170712:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873752448 00000100:00100000:0.0:1784045227.170737:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784045227.170743:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873752448:12345-0@lo:256: 20000000:01000000:0.0:1784045227.170757:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784045227.170784:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784045227.170787:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1784045227.170866:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873752448:12345-0@lo:256: Request processed in 122us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.170873:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784045227.170904:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873752448:0@lo:256: 10000000:01000000:0.0:1784045227.170945:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784045227.170952:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c3c7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.170960:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c3c7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045227.170968:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1784045227.170970:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1784045227.170973:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784045227.170997:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.171005:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.171012:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045227.171024:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873752576:0@lo:101: 00000100:00100000:0.0:1784045227.171047:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.171075:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c937eaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784045227.173903:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873752576 00000100:00100000:2.0:1784045227.173918:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873752576 00000100:00100000:2.0:1784045227.173978:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784045227.173988:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873752576:12345-0@lo:101: 00010000:00010000:2.0:1784045227.174003:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045227.174031:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc21fda00/0x5475624df454c3d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c3ce expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.174059:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc21fda00/0x5475624df454c3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c3ce expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.174069:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc21fda00/0x5475624df454c3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c3ce expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.174078:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fda00, rc 0) 00000100:00100000:2.0:1784045227.174165:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873752576:12345-0@lo:101: Request processed in 178us (3115us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.174172:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784045227.178757:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873752576:0@lo:101: 00010000:00010000:3.0:1784045227.178786:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c3d5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045227.178799:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c3d5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045227.178889:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91560700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873752704:0@lo:501: 00000100:00100000:3.0:1784045227.178945:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045227.178987:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc1268d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.179124:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873752704 00000100:00100000:0.0:1784045227.179131:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873752704 00000100:00100000:0.0:1784045227.179179:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784045227.179188:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873752704:12345-0@lo:501: 00000100:00100000:0.0:1784045227.179334:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873752704:12345-0@lo:501: Request processed in 145us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.179342:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784045227.179597:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91560700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873752704:0@lo:501: 00000100:00100000:0.0:1784045227.179893:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873752832:0@lo:503: 00000100:00100000:0.0:1784045227.179933:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.180160:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a4c840 going to sleep for 11 seconds 00000100:00100000:2.0:1784045227.180878:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873752832 00000100:00100000:2.0:1784045227.180886:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873752832 00000100:00100000:2.0:1784045227.180935:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784045227.180944:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873752832:12345-0@lo:503: 00000100:00100000:2.0:1784045227.181063:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873752832:12345-0@lo:503: Request processed in 120us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.181071:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784045227.181236:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873752832:0@lo:503: 00000100:00100000:0.0:1784045227.181691:0:8641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8641:1870706873752960:0@lo:502: 00000100:00100000:0.0:1784045227.181737:0:8641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.181786:0:8641:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a4c840 going to sleep for 11 seconds 00000100:00100000:2.0:1784045227.181986:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873752960 00000100:00100000:2.0:1784045227.181992:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873752960 00000100:00100000:2.0:1784045227.182029:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784045227.182037:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:8641:x1870706873752960:12345-0@lo:502: 00000100:00100000:2.0:1784045227.182152:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:8641:x1870706873752960:12345-0@lo:502: Request processed in 115us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.182160:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784045227.182281:0:8641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8641:1870706873752960:0@lo:502: 00000020:01000000:0.0:1784045227.182313:0:8641:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784045227.182322:0:8641:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1784045227.182328:0:8641:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045227.182330:0:8641:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784045227.182335:0:8641:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784045227.182338:0:8641:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:0.0:1784045227.182359:0:8641:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1784045227.182362:0:8641:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784045227.182376:0:8641:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff939cb59d19c0) 00000020:00000080:0.0:1784045227.182398:0:8641:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1784045227.182404:0:8641:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784045227.182532:0:8641:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1784045227.182538:0:8641:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1784045227.182545:0:8641:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5475624df454c3e3 00010000:00080000:0.0:1784045227.182585:0:8641:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939b82344000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:0.0:1784045227.182818:0:8641:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1784045227.225004:0:8641:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1784045227.225032:0:8641:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1784045227.225253:0:8641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045227.225490:0:8641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045227.225796:0:8641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1784045227.225882:0:8641:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1784045227.234911:0:8642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784045227.234921:0:8642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784045227.241663:0:8641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784045227.241687:0:8641:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784045227.241758:0:8641:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784045227.241787:0:8641:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454c3ea 00000100:00080000:0.0:1784045227.241797:0:8641:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784045227.241803:0:8641:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff939b82344000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045227.241841:0:8641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b81999180 x1870706873753088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784045227.241891:0:8641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784045227.241974:0:8641:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045227.241978:0:8641:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045227.241980:0:8641:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784045227.241982:0:8641:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045227.241986:0:8641:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045227.241987:0:8641:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784045227.241990:0:8641:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784045227.241992:0:8641:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784045227.242020:0:8641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8641:1870706873753216:0@lo:502: 00000100:00100000:0.0:1784045227.242096:0:8641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.242144:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873753216 00000100:00100000:0.0:1784045227.242151:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873753216 00000100:00100000:0.0:1784045227.242187:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784045227.242196:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:8641:x1870706873753216:12345-0@lo:502: 00000100:00100000:0.0:1784045227.242312:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:8641:x1870706873753216:12345-0@lo:502: Request processed in 116us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.242320:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784045227.242380:0:8641:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a4c840 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.242401:0:8641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8641:1870706873753216:0@lo:502: 00000020:01000000:0.0:1784045227.242424:0:8641:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045227.242429:0:8641:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045227.242430:0:8641:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784045227.242434:0:8641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:3.0:1784045227.242898:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873753088:0@lo:8: 00000100:00100000:3.0:1784045227.242938:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.242990:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873753088 00000100:00100000:0.0:1784045227.242995:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873753088 00000100:00100000:0.0:1784045227.243024:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784045227.243030:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1870706873753088:12345-0@lo:8: 00010000:00080000:0.0:1784045227.243060:0:8411:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:0.0:1784045227.243086:0:8411:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454c3f1 00002000:00100000:0.0:1784045227.243124:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff939b82343000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1784045227.243129:0:8411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1784045227.243132:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1784045227.243191:0:8411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784045227.243438:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1784045227.243507:0:8411:0:(import.c:65:import_set_state_nolock()) ffff939b82343800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045227.243559:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1870706873753088:12345-0@lo:8: Request processed in 528us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.243566:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784045227.243615:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b81999180 x1870706873753088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784045237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045227.243626:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784045227.243633:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1784045227.243641:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784045227.243645:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784045227.243647:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b82344000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784045227.243657:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784045227.243662:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873753088:0@lo:8: 00000020:01000000:2.0:1784045227.243945:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1784045227.243971:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784045227.243994:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c3d5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.244005:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c3d5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045227.244014:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784045227.244016:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939c9775c000 from 30 10000000:01000000:2.0:1784045227.244019:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784045227.244038:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.244046:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.244055:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045227.244067:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873754112:0@lo:101: 00000100:00100000:2.0:1784045227.244098:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.244118:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11e6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045227.244129:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873753728:0@lo:400: 00000100:00100000:2.0:1784045227.244149:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.244167:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784045227.244172:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873753344:0@lo:400: 00000100:00100000:2.0:1784045227.244189:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.244202:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873753856:0@lo:400: 00000100:00100000:2.0:1784045227.244222:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.244243:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873753600:0@lo:400: 00000100:00100000:2.0:1784045227.244272:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.244300:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784045227.244305:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873753472:0@lo:400: 00000100:00100000:2.0:1784045227.244325:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.244338:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873753984:0@lo:400: 00000100:00100000:2.0:1784045227.244359:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.244379:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873753728 00000100:00100000:2.0:1784045227.244384:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873753728 00000100:00100000:2.0:1784045227.244414:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873753472 00000100:00100000:2.0:1784045227.244417:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873753472 00000100:00100000:2.0:1784045227.244431:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045227.244437:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873753728:12345-0@lo:400: 00000100:00100000:2.0:1784045227.244518:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873753728:12345-0@lo:400: Request processed in 80us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.244525:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045227.244539:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784045227.244545:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873753472:12345-0@lo:400: 00000100:00100000:2.0:1784045227.244575:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873753472:12345-0@lo:400: Request processed in 30us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.244581:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784045227.244598:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873753344 00000100:00100000:2.0:1784045227.244602:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873753344 00000100:00100000:2.0:1784045227.244617:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873753856 00000100:00100000:2.0:1784045227.244619:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873753856 00000100:00100000:2.0:1784045227.244635:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873753600 00000100:00100000:2.0:1784045227.244637:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873753600 00000100:00100000:2.0:1784045227.244647:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873753984 00000100:00100000:2.0:1784045227.244649:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873753984 00000100:00100000:2.0:1784045227.244679:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784045227.244691:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873753344:12345-0@lo:400: 00000100:00100000:2.0:1784045227.244721:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873753344:12345-0@lo:400: Request processed in 31us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.244728:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784045227.244739:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045227.244745:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873753856:12345-0@lo:400: 00000100:00100000:2.0:1784045227.244771:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873753856:12345-0@lo:400: Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.244777:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045227.244786:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045227.244792:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873753600:12345-0@lo:400: 00000100:00100000:2.0:1784045227.244817:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873753600:12345-0@lo:400: Request processed in 26us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.244824:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045227.244834:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045227.244839:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873753984:12345-0@lo:400: 00000100:00100000:2.0:1784045227.244863:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873753984:12345-0@lo:400: Request processed in 25us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.244869:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1784045227.244899:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939c8820ed80 x1870706873753344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045227.244911:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873753344:0@lo:400: 00010000:00080000:2.0:1784045227.244920:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939c8820e300 x1870706873753856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045227.244927:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873753856:0@lo:400: 00000100:00100000:2.0:1784045227.244945:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873753728:0@lo:400: 00000100:00100000:2.0:1784045227.244975:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873753472:0@lo:400: 00010000:00080000:2.0:1784045227.244984:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82379500 x1870706873753984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045227.244992:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873753984:0@lo:400: 00010000:00080000:2.0:1784045227.245001:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939c8820ca80 x1870706873753600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045227.245008:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873753600:0@lo:400: 00000004:00080000:3.0:1784045227.245438:0:8642:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784045227.245557:0:8642:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 183354112133ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784045227.245565:0:8642:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:3.0:1784045227.245590:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784045227.245594:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045227.245631:0:8643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8643:1870706873754240:0@lo:700: 00000100:00100000:3.0:1784045227.245671:0:8643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045227.245691:0:8643:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc1268840 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.246224:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873754112 00000100:00100000:0.0:1784045227.246231:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873754112 00000100:00100000:0.0:1784045227.246269:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784045227.246277:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873754112:12345-0@lo:101: 00010000:00010000:0.0:1784045227.246289:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1784045227.246428:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873754240 00000100:00100000:2.0:1784045227.246433:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873754240 00000100:00100000:2.0:1784045227.246500:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045227.246506:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8643:x1870706873754240:12345-0@lo:700: 00000100:00100000:2.0:1784045227.246552:0:8420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8420:1870706873754368:0@lo:700: 00000100:00100000:2.0:1784045227.246590:0:8420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.246611:0:8420:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11e6780 going to sleep for 11 seconds 00000100:00080000:2.0:1784045227.246634:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045227.246648:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873754368 00000100:00100000:2.0:1784045227.246651:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873754368 00000100:00100000:2.0:1784045227.246675:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784045227.246681:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8420:x1870706873754368:12345-0@lo:700: 00010000:00010000:0.0:1784045227.247261:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915aa200/0x5475624df454c3ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c3f8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.247368:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915aa200/0x5475624df454c3ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c3f8 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.247381:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915aa200/0x5475624df454c3ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c3f8 expref: 18 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.247391:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aa200, rc 0) 00000100:00100000:0.0:1784045227.247483:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873754112:12345-0@lo:101: Request processed in 1207us (3384us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.247491:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784045227.247560:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873754112:0@lo:101: 00010000:00010000:0.0:1784045227.247576:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c3ff expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.247586:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c3ff expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045227.247661:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873754496:0@lo:501: 00000100:00100000:0.0:1784045227.247692:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.251775:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045227.253498:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873754496 00000100:00100000:3.0:1784045227.253518:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873754496 00000100:00100000:3.0:1784045227.253602:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784045227.253614:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873754496:12345-0@lo:501: 00000100:00100000:3.0:1784045227.254485:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873754496:12345-0@lo:501: Request processed in 825us (6745us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045227.254497:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000004:00080000:3.0:1784045227.254624:0:7428:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1784045227.255248:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873754496:0@lo:501: 00000100:00100000:2.0:1784045227.255331:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873754624:0@lo:503: 00000100:00100000:2.0:1784045227.255411:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.255508:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11e6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.255826:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873754624 00000100:00100000:0.0:1784045227.255833:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873754624 00000100:00100000:0.0:1784045227.255876:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784045227.255884:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873754624:12345-0@lo:503: 00000100:00100000:0.0:1784045227.256023:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873754624:12345-0@lo:503: Request processed in 139us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.256031:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784045227.256090:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873754624:0@lo:503: 00000100:00100000:0.0:1784045227.256419:0:8644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8644:1870706873754752:0@lo:502: 00000100:00100000:0.0:1784045227.256491:0:8644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.256513:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873754752 00000100:00100000:0.0:1784045227.256517:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873754752 00000100:00100000:0.0:1784045227.256541:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784045227.256548:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:8644:x1870706873754752:12345-0@lo:502: 00000100:00100000:0.0:1784045227.256625:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:8644:x1870706873754752:12345-0@lo:502: Request processed in 77us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.256631:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784045227.256673:0:8644:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8558de40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.256686:0:8644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8644:1870706873754752:0@lo:502: 00000100:00100000:0.0:1784045227.256727:0:8644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8644:1870706873754880:0@lo:502: 00000100:00100000:0.0:1784045227.256758:0:8644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.256777:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873754880 00000100:00100000:0.0:1784045227.256781:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873754880 00000100:00100000:0.0:1784045227.256800:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784045227.256806:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:8644:x1870706873754880:12345-0@lo:502: 00000100:00100000:0.0:1784045227.256866:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:8644:x1870706873754880:12345-0@lo:502: Request processed in 60us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.256871:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784045227.256898:0:8644:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8558de40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.256910:0:8644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8644:1870706873754880:0@lo:502: 00000040:00080000:0.0:1784045227.256928:0:8644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1784045227.256977:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1784045227.257001:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784045227.257009:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c3ff expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.257019:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c3ff expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045227.257028:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784045227.257031:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939c9775c000 from 5 10000000:01000000:0.0:1784045227.257033:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784045227.257064:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.257073:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.257081:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045227.257093:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873755008:0@lo:101: 00000100:00100000:0.0:1784045227.257119:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.257132:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8558de40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.257143:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873755008 00000100:00100000:0.0:1784045227.257146:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873755008 00000100:00100000:0.0:1784045227.257166:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784045227.257172:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873755008:12345-0@lo:101: 00010000:00010000:0.0:1784045227.257180:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045227.257192:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915aa800/0x5475624df454c40d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c406 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.257223:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915aa800/0x5475624df454c40d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c406 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.257234:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915aa800/0x5475624df454c40d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c406 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.257243:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aa800, rc 0) 00000100:00100000:0.0:1784045227.257272:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873755008:12345-0@lo:101: Request processed in 100us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.257277:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784045227.257929:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873755008:0@lo:101: 00010000:00010000:2.0:1784045227.257944:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c40d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.257953:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c40d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045227.258011:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873755136:0@lo:256: 00000100:00100000:2.0:1784045227.258048:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.258071:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c873389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.258405:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873755136 00000100:00100000:0.0:1784045227.258411:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873755136 00000100:00100000:0.0:1784045227.258476:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784045227.258486:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873755136:12345-0@lo:256: 20000000:01000000:0.0:1784045227.258504:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784045227.258520:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784045227.258523:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1784045227.258616:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873755136:12345-0@lo:256: Request processed in 132us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.258625:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784045227.258831:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873755136:0@lo:256: 10000000:01000000:2.0:1784045227.258937:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784045227.258949:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c40d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.258960:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c40d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045227.258971:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784045227.258974:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1784045227.258977:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784045227.259064:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.259074:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045227.259089:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045227.259115:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873755264:0@lo:101: 00000100:00100000:2.0:1784045227.259178:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.259221:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8558de40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.259367:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873755264 00000100:00100000:0.0:1784045227.259374:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873755264 00000100:00100000:0.0:1784045227.259410:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784045227.259416:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873755264:12345-0@lo:101: 00010000:00010000:0.0:1784045227.259426:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045227.259440:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915aac00/0x5475624df454c41b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c414 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.259510:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915aac00/0x5475624df454c41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c414 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.259521:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915aac00/0x5475624df454c41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c414 expref: 20 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.259530:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aac00, rc 0) 40000000:02000000:2.0:1784045227.259580:0:6503:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1784045227.259589:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873755264:12345-0@lo:101: Request processed in 171us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.259600:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784045227.259645:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873755264:0@lo:101: 00010000:00010000:0.0:1784045227.259872:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c41b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.259882:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c41b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045227.259946:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873755392:0@lo:501: 00000100:00100000:0.0:1784045227.259977:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.260106:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c832c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1784045227.260137:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873755392 00000100:00100000:1.0:1784045227.260142:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873755392 00000100:00100000:1.0:1784045227.260170:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784045227.260176:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873755392:12345-0@lo:501: 00000100:00100000:1.0:1784045227.260377:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873755392:12345-0@lo:501: Request processed in 200us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045227.260392:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784045227.260518:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873755392:0@lo:501: 00000100:00100000:0.0:1784045227.260545:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873755520:0@lo:503: 00000100:00100000:0.0:1784045227.260585:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.260642:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c832c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1784045227.260724:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873755520 00000100:00100000:1.0:1784045227.260729:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873755520 00000100:00100000:1.0:1784045227.260784:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784045227.260792:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873755520:12345-0@lo:503: 00000100:00100000:1.0:1784045227.260870:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873755520:12345-0@lo:503: Request processed in 78us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045227.260876:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784045227.260935:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873755520:0@lo:503: 00000100:00100000:1.0:1784045227.261417:0:8645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8645:1870706873755648:0@lo:502: 00000100:00100000:0.0:1784045227.261604:0:8645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.261673:0:8645:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92dfc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045227.261752:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873755648 00000100:00100000:1.0:1784045227.261757:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873755648 00000100:00100000:1.0:1784045227.261825:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784045227.261832:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:8645:x1870706873755648:12345-0@lo:502: 00000100:00100000:1.0:1784045227.261937:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:8645:x1870706873755648:12345-0@lo:502: Request processed in 104us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045227.261943:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784045227.262016:0:8645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8645:1870706873755648:0@lo:502: 00000020:01000000:0.0:1784045227.262040:0:8645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784045227.262046:0:8645:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784045227.262052:0:8645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045227.262054:0:8645:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784045227.262060:0:8645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784045227.262062:0:8645:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:0.0:1784045227.262084:0:8645:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784045227.262087:0:8645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784045227.262100:0:8645:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff939cb59d0000) 00000020:00000080:0.0:1784045227.262121:0:8645:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1784045227.262127:0:8645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784045227.262198:0:8645:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1784045227.262203:0:8645:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1784045227.262209:0:8645:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454c429 00010000:00080000:0.0:1784045227.262236:0:8645:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939b82187800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:0.0:1784045227.262611:0:8645:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:2.0:1784045227.274269:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8420:x1870706873754368:12345-0@lo:700: Request processed in 27573us (27664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.274289:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784045227.274373:0:8420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82379500 x1870706873754368/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784045243 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045227.274392:0:8420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8420:1870706873754368:0@lo:700: 40000000:02000000:2.0:1784045227.274409:0:8420:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:1.0:1784045227.280262:0:8645:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1784045227.280297:0:8645:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784045227.280620:0:8645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045227.280833:0:8645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045227.280910:0:8645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1784045227.280987:0:8645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1784045227.283962:0:8646:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045227.283974:0:8646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784045227.284750:0:8645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784045227.284765:0:8645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784045227.284812:0:8645:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784045227.284851:0:8645:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454c430 00000100:00080000:1.0:1784045227.284865:0:8645:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784045227.284874:0:8645:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939b82187800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1784045227.284922:0:8645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939c915c1880 x1870706873755776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784045227.284949:0:8645:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1784045227.285022:0:8645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045227.285026:0:8645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045227.285028:0:8645:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784045227.285032:0:8645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045227.285036:0:8645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045227.285038:0:8645:0:(obd_config.c:1561:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784045227.285041:0:8645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784045227.285043:0:8645:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784045227.285078:0:8645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8645:1870706873755904:0@lo:502: 00000100:00100000:1.0:1784045227.285183:0:8645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045227.285228:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873755904 00000100:00100000:1.0:1784045227.285237:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873755904 00000100:00100000:1.0:1784045227.285282:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784045227.285293:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:8645:x1870706873755904:12345-0@lo:502: 00000100:00100000:1.0:1784045227.285418:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:8645:x1870706873755904:12345-0@lo:502: Request processed in 126us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045227.285427:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784045227.285522:0:8645:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c907fef00 going to sleep for 11 seconds 00000100:00100000:1.0:1784045227.285551:0:8645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:8645:1870706873755904:0@lo:502: 00000020:01000000:1.0:1784045227.285581:0:8645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045227.285585:0:8645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045227.285587:0:8645:0:(obd_config.c:1561:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784045227.285590:0:8645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:0.0:1784045227.285809:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873755776:0@lo:8: 00000100:00100000:0.0:1784045227.285856:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1784045227.285912:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1784045227.285938:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784045227.285950:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c41b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.285961:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c41b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045227.285984:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784045227.285987:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff939c901d3380 from 1 10000000:01000000:0.0:1784045227.285991:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784045227.286021:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.286031:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.286041:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045227.286055:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873756032:0@lo:101: 00000100:00100000:0.0:1784045227.286084:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.286101:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c832c7180 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.286116:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873756032 00000100:00100000:0.0:1784045227.286120:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873756032 00000100:00100000:0.0:1784045227.286151:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784045227.286158:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873756032:12345-0@lo:101: 00010000:00010000:0.0:1784045227.286168:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045227.286183:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915ab600/0x5475624df454c43e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c437 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.286210:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915ab600/0x5475624df454c43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c437 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.286222:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915ab600/0x5475624df454c43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c437 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.286243:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915ab600, rc 0) 00000100:00100000:0.0:1784045227.286276:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873756032:12345-0@lo:101: Request processed in 118us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.286282:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784045227.286318:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873756032:0@lo:101: 00010000:00010000:0.0:1784045227.286332:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c43e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.286342:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c43e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045227.286393:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873756160:0@lo:501: 00000100:00100000:0.0:1784045227.286419:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.286434:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11e6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.286487:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873756160 00000100:00100000:0.0:1784045227.286491:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873756160 00000100:00100000:3.0:1784045227.286495:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873755776 00000100:00100000:3.0:1784045227.286502:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873755776 00000100:00100000:0.0:1784045227.286520:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784045227.286530:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873756160:12345-0@lo:501: 00000100:00100000:3.0:1784045227.286536:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045227.286543:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1870706873755776:12345-0@lo:8: 00010000:00080000:3.0:1784045227.286572:0:8413:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000100:00100000:0.0:1784045227.286607:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873756160:12345-0@lo:501: Request processed in 79us (186us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784045227.286615:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784045227.286650:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873756160:0@lo:501: 10000000:01000000:0.0:1784045227.286674:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784045227.286680:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c43e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045227.286698:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c43e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784045227.288066:0:8413:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454c445 00002000:00100000:3.0:1784045227.288093:0:8413:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff939b81988000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784045227.288112:0:8413:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1784045227.288116:0:8413:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784045227.288217:0:8413:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784045227.288255:0:8413:0:(import.c:65:import_set_state_nolock()) ffff939b8198a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045227.288364:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1870706873755776:12345-0@lo:8: Request processed in 1816us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045227.288374:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784045227.288483:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939c915c1880 x1870706873755776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784045237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045227.288495:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784045227.288505:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784045227.288515:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784045227.288521:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784045227.288525:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b82187800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784045227.288544:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784045227.288550:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873755776:0@lo:8: 00000004:00080000:1.0:1784045227.288698:0:8646:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784045227.288749:0:8646:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 183397303807ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784045227.288756:0:8646:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1784045227.293227:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1784045227.293365:0:8647:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1784045227.293403:0:8647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8647:1870706873756416:0@lo:7: 00000100:00100000:0.0:1784045227.293533:0:8647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.293572:0:8647:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11e6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045227.293593:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045227.293609:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873756288:0@lo:13: 00000100:00100000:0.0:1784045227.293639:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.293679:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873756416 00000100:00100000:0.0:1784045227.293688:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873756416 00000100:00100000:0.0:1784045227.293765:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045227.293776:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8647:x1870706873756416:12345-0@lo:7: 00000100:00100000:2.0:1784045227.296762:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873756288 00000100:00100000:2.0:1784045227.296777:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873756288 00000100:00100000:2.0:1784045227.296843:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045227.296854:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1870706873756288:12345-0@lo:13: 00002000:00000024:2.0:1784045227.296889:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923881984 avail 3692359680 00000100:00100000:2.0:1784045227.297003:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81998700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1870706873756288:12345-0@lo:13: Request processed in 150us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.297011:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1784045227.297039:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784045227.297071:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b8199b800 x1870706873756288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045227.297099:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873756288:0@lo:13: 00000001:00100000:2.0:1784045227.299366:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1784045227.299377:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1784045227.299543:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8643:x1870706873754240:12345-0@lo:700: Request processed in 53032us (53866us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.299558:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784045227.299635:0:8643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939c91561880 x1870706873754240/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784045243 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045227.299650:0:8643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8643:1870706873754240:0@lo:700: 00002000:00080000:0.0:1784045227.304593:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1784045227.304613:0:8412:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1784045227.304742:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8647:x1870706873756416:12345-0@lo:7: Request processed in 10961us (11203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045227.304756:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784045227.305017:0:8647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b8199aa00 x1870706873756416/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784045243 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045227.305035:0:8647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8647:1870706873756416:0@lo:7: 00000004:00080000:1.0:1784045227.305054:0:8647:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1784045227.305104:0:8647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8647:1870706873756544:0@lo:5: 00000100:00100000:1.0:1784045227.305148:0:8647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045227.305174:0:8647:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c878e1300 going to sleep for 11 seconds 00000100:00100000:3.0:1784045227.305386:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873756544 00000100:00100000:3.0:1784045227.305394:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873756544 00000100:00100000:3.0:1784045227.305485:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784045227.305496:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8647:x1870706873756544:12345-0@lo:5: 00002000:00080000:3.0:1784045227.305527:0:8413:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1784045227.305532:0:8413:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1784045227.305903:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8647:x1870706873756544:12345-0@lo:5: Request processed in 409us (754us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784045227.305911:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784045227.306543:0:8647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939c915c0380 x1870706873756544/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045243 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045227.306558:0:8647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8647:1870706873756544:0@lo:5: 00000004:00080000:0.0:1784045227.306571:0:8647:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1784045227.306608:0:8647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8647:1870706873756672:0@lo:700: 00000100:00100000:0.0:1784045227.306650:0:8647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045227.306677:0:8647:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11e6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045227.308583:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873756672 00000100:00100000:3.0:1784045227.308599:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873756672 00000100:00100000:3.0:1784045227.308678:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045227.308689:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8647:x1870706873756672:12345-0@lo:700: 00000001:00080000:1.0:1784045227.317970:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1784045227.318251:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8647:x1870706873756672:12345-0@lo:700: Request processed in 9557us (11593us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.318261:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873756800:0@lo:13: 00000100:00100000:3.0:1784045227.318269:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784045227.318753:0:8647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b81998a80 x1870706873756672/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784045243 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045227.318768:0:8647:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784045227.318789:0:8647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8647:1870706873756672:0@lo:700: 00000100:00100000:2.0:1784045227.318811:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1784045227.318836:0:8643:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1784045227.318869:0:8643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8643:1870706873756928:0@lo:7: 00000100:00100000:2.0:1784045227.318898:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873756800 00000100:00100000:2.0:1784045227.318907:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873756800 00000100:00100000:3.0:1784045227.318909:0:8643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045227.318958:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873756928 00000100:00100000:2.0:1784045227.318960:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045227.318972:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873756928 00000100:00100000:2.0:1784045227.318973:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873756800:12345-0@lo:13: 00002000:00000024:2.0:1784045227.319004:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923881984 avail 3692359680 00000100:00100000:3.0:1784045227.319013:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784045227.319022:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8643:x1870706873756928:12345-0@lo:7: 00000100:00100000:2.0:1784045227.319048:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1870706873756800:12345-0@lo:13: Request processed in 78us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.319056:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784045227.319337:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82379500 x1870706873756800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045227.319353:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873756800:0@lo:13: 00000100:00100000:2.0:1784045227.320158:0:8643:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc12689c0 going to sleep for 11 seconds 00000004:02000040:2.0:1784045227.327328:0:8647:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1784045227.333718:0:8647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8647:1870706873757056:0@lo:5: 00000100:00100000:2.0:1784045227.333822:0:8647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1784045227.334843:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1784045227.334853:0:8412:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1784045227.336493:0:8411:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1784045227.336892:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8643:x1870706873756928:12345-0@lo:7: Request processed in 17863us (17975us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045227.336908:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784045227.338188:0:8643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939c91562d80 x1870706873756928/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784045243 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045227.338208:0:8643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8643:1870706873756928:0@lo:7: 00000004:00080000:2.0:1784045227.338225:0:8643:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1784045227.338282:0:8643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8643:1870706873757184:0@lo:5: 00000100:00100000:2.0:1784045227.338358:0:8643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045227.339162:0:8411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1784045227.339212:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873757056 00000100:00100000:3.0:1784045227.339222:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873757056 00000100:00100000:3.0:1784045227.339284:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784045227.339295:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8647:x1870706873757056:12345-0@lo:5: 00000100:00100000:1.0:1784045227.343524:0:8647:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8558de40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045227.344178:0:8643:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc12689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045227.344286:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873757184 00000100:00100000:1.0:1784045227.344298:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873757184 00000100:00100000:1.0:1784045227.344410:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784045227.344424:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8643:x1870706873757184:12345-0@lo:5: 00002000:00080000:1.0:1784045227.344494:0:8413:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1784045227.344602:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8643:x1870706873757184:12345-0@lo:5: Request processed in 182us (6243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045227.344611:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784045227.344739:0:8643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82379180 x1870706873757184/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045243 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045227.344760:0:8643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8643:1870706873757184:0@lo:5: 00000004:00080000:2.0:1784045227.344778:0:8643:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1784045227.344834:0:8643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8643:1870706873757312:0@lo:5: 00000100:00100000:2.0:1784045227.345042:0:8643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.345066:0:8643:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc12689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045227.345109:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873757312 00000100:00100000:1.0:1784045227.345114:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873757312 00000100:00100000:1.0:1784045227.345190:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784045227.345201:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8643:x1870706873757312:12345-0@lo:5: 00002000:00080000:1.0:1784045227.345237:0:8413:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1784045227.350247:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8643:x1870706873757312:12345-0@lo:5: Request processed in 5039us (5195us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784045227.350264:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1784045227.350578:0:8643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82379180 x1870706873757312/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045243 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045227.350602:0:8643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8643:1870706873757312:0@lo:5: 00000004:00080000:2.0:1784045227.350624:0:8643:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1784045227.350680:0:8643:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8643:1870706873757440:0@lo:900: 00000100:00100000:2.0:1784045227.350791:0:8643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045227.350840:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873757440 00000100:00100000:2.0:1784045227.350848:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873757440 00000100:00100000:2.0:1784045227.350953:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784045227.350964:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8643:x1870706873757440:12345-0@lo:900: 00000100:00100000:2.0:1784045227.351015:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8643:x1870706873757440:12345-0@lo:900: Request processed in 53us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045227.351023:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784045227.351048:0:8643:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc12689c0 going to sleep for 11 seconds 00010000:00080000:2.0:1784045227.351062:0:8643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b8237b800 x1870706873757440/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784045243 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045227.351088:0:8643:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8643:1870706873757440:0@lo:900: 00002000:00080000:2.0:1784045227.355674:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1784045227.355708:0:8412:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1784045227.358657:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8647:x1870706873757056:12345-0@lo:5: Request processed in 19353us (24824us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784045227.358682:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1784045227.358693:0:8647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82379500 x1870706873757056/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045243 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045227.358718:0:8647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8647:1870706873757056:0@lo:5: 00000004:00080000:1.0:1784045227.358739:0:8647:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1784045227.987991:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045228.179697:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873757568:0@lo:41: 00000100:00100000:0.0:1784045228.179772:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045228.179834:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873757568 00000100:00100000:2.0:1784045228.179842:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873757568 00000100:00100000:2.0:1784045228.179895:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784045228.179903:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873757568:12345-0@lo:41: 00000004:00000024:2.0:1784045228.179935:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1784045228.179980:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873757568:12345-0@lo:41: Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045228.179987:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784045228.180042:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873757568:0@lo:41: 00010000:00010000:1.0:1784045229.011822:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784045229.526887:0:8788:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1784045229.716607:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045229.716634:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873757696:0@lo:41: 00000100:00100000:1.0:1784045229.716704:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045229.716926:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873757696 00000100:00100000:3.0:1784045229.716934:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873757696 00000100:00100000:3.0:1784045229.716990:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784045229.717000:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873757696:12345-0@lo:41: 00000004:00000024:3.0:1784045229.717035:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1784045229.717085:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873757696:12345-0@lo:41: Request processed in 87us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045229.717092:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784045229.717259:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873757696:0@lo:41: 00010000:00010000:1.0:1784045230.039422:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784045230.341893:0:8840:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045230.342084:0:8840:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:2.0:1784045231.026306:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1784045231.026333:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1784045231.059836:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045232.090241:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045232.787808:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045232.787846:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873757824:0@lo:13: 00000100:00100000:3.0:1784045232.787920:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045232.787989:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873757824 00000100:00100000:3.0:1784045232.787996:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873757824 00000100:00100000:3.0:1784045232.788052:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784045232.788060:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873757824:12345-0@lo:13: 00002000:00000024:3.0:1784045232.788089:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045232.788132:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873757824:12345-0@lo:13: Request processed in 73us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045232.788139:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1784045232.788158:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784045232.788186:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939c91561180 x1870706873757824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045232.788198:0:3623:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784045232.788219:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873757824:0@lo:13: 00000100:00100000:0.0:1784045232.788790:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873757952:0@lo:400: 00000100:00100000:0.0:1784045232.788845:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045232.788874:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873758464:0@lo:400: 00000100:00100000:0.0:1784045232.788895:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045232.788913:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045232.788919:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873758080:0@lo:400: 00000100:00100000:0.0:1784045232.788941:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045232.788967:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873758336:0@lo:400: 00000100:00100000:0.0:1784045232.788988:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045232.789016:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045232.789021:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873758208:0@lo:400: 00000100:00100000:0.0:1784045232.789044:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045232.789069:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873757952 00000100:00100000:0.0:1784045232.789074:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873757952 00000100:00100000:0.0:1784045232.789104:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784045232.789111:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:3625:x1870706873757952:12345-0@lo:400: 00000100:00100000:0.0:1784045232.789147:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:3625:x1870706873757952:12345-0@lo:400: Request processed in 37us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045232.789153:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784045232.789180:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873758464 00000100:00100000:0.0:1784045232.789183:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873758464 00000100:00100000:0.0:1784045232.789206:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873758208 00000100:00100000:0.0:1784045232.789208:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873758208 00000100:00100000:0.0:1784045232.789221:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784045232.789227:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873758464:12345-0@lo:400: 00000100:00100000:0.0:1784045232.789259:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873758464:12345-0@lo:400: Request processed in 32us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045232.789265:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784045232.789276:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784045232.789281:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873758208:12345-0@lo:400: 00000100:00100000:0.0:1784045232.789308:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873758208:12345-0@lo:400: Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045232.789313:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784045232.789328:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873758080 00000100:00100000:0.0:1784045232.789331:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873758080 00000100:00100000:0.0:1784045232.789350:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873758336 00000100:00100000:0.0:1784045232.789353:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873758336 00000100:00100000:0.0:1784045232.789374:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045232.789378:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873758080:12345-0@lo:400: 00000100:00100000:0.0:1784045232.789408:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873758080:12345-0@lo:400: Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045232.789414:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045232.789425:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784045232.789442:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873758336:12345-0@lo:400: 00000100:00100000:0.0:1784045232.789488:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873758336:12345-0@lo:400: Request processed in 58us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045232.789494:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784045232.789537:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873758208:0@lo:400: 00010000:00080000:0.0:1784045232.789564:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b8237a300 x1870706873758336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045232.789573:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873758336:0@lo:400: 00010000:00080000:0.0:1784045232.789599:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82379180 x1870706873758080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045232.789607:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873758080:0@lo:400: 00000100:00100000:0.0:1784045232.789616:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873757952:0@lo:400: 00000100:00100000:0.0:1784045232.789623:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873758464:0@lo:400: 00000100:00100000:3.0:1784045232.790042:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873758592:0@lo:400: 00000100:00100000:3.0:1784045232.790078:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045232.790109:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873758720:0@lo:400: 00000100:00100000:3.0:1784045232.790130:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045232.790144:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045232.790149:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873758848:0@lo:400: 00000100:00100000:3.0:1784045232.790173:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045232.790201:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873758848 00000100:00100000:3.0:1784045232.790205:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873758848 00000100:00100000:0.0:1784045232.790313:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873758592 00000100:00100000:0.0:1784045232.790317:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873758592 00000100:00100000:0.0:1784045232.790352:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873758720 00000100:00100000:0.0:1784045232.790356:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873758720 00000100:00100000:0.0:1784045232.790372:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045232.790377:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873758592:12345-0@lo:400: 00000100:00100000:0.0:1784045232.790439:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873758592:12345-0@lo:400: Request processed in 50us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045232.790465:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045232.790481:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784045232.790487:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873758720:12345-0@lo:400: 00000100:00100000:0.0:1784045232.790522:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873758720:12345-0@lo:400: Request processed in 35us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045232.790528:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1784045232.790679:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82378700 x1870706873758592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045232.790761:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873758592:0@lo:400: 00000100:00080000:2.0:1784045232.792508:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045232.792516:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045232.792519:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045232.793575:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045232.793600:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873758976:0@lo:13: 00000100:00100000:0.0:1784045232.793682:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045232.793938:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873758976 00000100:00100000:2.0:1784045232.793946:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873758976 00000100:00100000:2.0:1784045232.794000:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045232.794009:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1870706873758976:12345-0@lo:13: 00002000:00000024:2.0:1784045232.794032:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045232.794074:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1870706873758976:12345-0@lo:13: Request processed in 67us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045232.794082:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784045232.794704:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b8237b800 x1870706873758720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045232.794719:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873758720:0@lo:400: 00000100:00100000:1.0:1784045232.797410:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784045232.797532:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b8237a300 x1870706873758976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045232.797546:0:3626:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1784045232.797571:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873758976:0@lo:13: 00000100:00100000:1.0:1784045232.800455:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873758848:12345-0@lo:400: 00000100:00100000:1.0:1784045232.800710:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873758848:12345-0@lo:400: Request processed in 3288us (10535us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045232.800719:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784045232.807713:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82379180 x1870706873758848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045232.807733:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873758848:0@lo:400: 00000020:00000004:0.0:1784045232.863027:0:8941:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045232.863248:0:8941:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784045233.107733:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045233.304818:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873759104:0@lo:41: 00000100:00100000:2.0:1784045233.304886:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045233.304981:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873759104 00000100:00100000:3.0:1784045233.304989:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873759104 00000100:00100000:3.0:1784045233.305051:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784045233.305060:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873759104:12345-0@lo:41: 00000004:00000024:3.0:1784045233.305113:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1784045233.305411:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873759104:12345-0@lo:41: Request processed in 351us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045233.305418:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784045233.305606:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873759104:0@lo:41: 00000020:00000004:3.0:1784045233.737658:0:8989:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784045233.737677:0:8989:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1784045234.132848:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045234.835643:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045234.843650:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873759232:0@lo:41: 00000100:00100000:0.0:1784045234.843746:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045234.843874:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873759232 00000100:00100000:3.0:1784045234.843882:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873759232 00000100:00100000:3.0:1784045234.843928:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784045234.843937:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873759232:12345-0@lo:41: 00000004:00000024:3.0:1784045234.843970:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1784045234.844037:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873759232:12345-0@lo:41: Request processed in 101us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045234.844046:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784045234.844345:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873759232:0@lo:41: 00010000:00010000:1.0:1784045235.156165:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045236.181940:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045237.203936:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045237.908499:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045237.908527:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873759616:0@lo:400: 00000100:00100000:3.0:1784045237.908585:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873760000:0@lo:400: 00000100:00100000:2.0:1784045237.908601:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045237.908681:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873759744:0@lo:400: 00000100:00100000:0.0:1784045237.909895:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873759360:0@lo:13: 00000100:00100000:3.0:1784045237.914188:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045237.914262:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873760512:0@lo:400: 00000100:00100000:3.0:1784045237.914321:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045237.914355:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045237.914361:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873760128:0@lo:400: 00000100:00100000:3.0:1784045237.914383:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045237.914433:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873760000 00000100:00100000:3.0:1784045237.914441:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873760000 00000100:00100000:3.0:1784045237.914501:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784045237.914510:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873760000:12345-0@lo:400: 00000100:00100000:3.0:1784045237.914569:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873760000:12345-0@lo:400: Request processed in 60us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045237.914592:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784045237.914616:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873760512 00000100:00100000:3.0:1784045237.914619:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873760512 00000100:00100000:3.0:1784045237.914652:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045237.914670:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873760512:12345-0@lo:400: 00000100:00100000:3.0:1784045237.914705:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873760512:12345-0@lo:400: Request processed in 47us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045237.914711:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045237.914732:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873759616 00000100:00100000:3.0:1784045237.914735:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873759616 00000100:00100000:3.0:1784045237.914756:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873760128 00000100:00100000:3.0:1784045237.914759:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873760128 00000100:00100000:3.0:1784045237.914780:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784045237.914785:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873759616:12345-0@lo:400: 00000100:00100000:3.0:1784045237.914818:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873759616:12345-0@lo:400: Request processed in 32us (6219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045237.914824:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784045237.914836:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784045237.914841:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873760128:12345-0@lo:400: 00000100:00100000:3.0:1784045237.914868:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873760128:12345-0@lo:400: Request processed in 26us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045237.914873:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1784045237.914894:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784045237.914899:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784045237.914942:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cc1374a80 x1870706873760128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045237.914957:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873760128:0@lo:400: 00000100:00100000:1.0:1784045237.914978:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045237.914983:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873760000:0@lo:400: 00010000:00080000:3.0:1784045237.914999:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cc1375880 x1870706873760512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045237.915010:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873760512:0@lo:400: 00000100:00100000:1.0:1784045237.915011:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873760256:0@lo:400: 00000100:00100000:3.0:1784045237.915046:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873759744 00000100:00100000:3.0:1784045237.915050:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873759744 00000100:00100000:1.0:1784045237.915059:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045237.915081:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784045237.915089:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873759744:12345-0@lo:400: 00000100:00100000:3.0:1784045237.915142:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873759744:12345-0@lo:400: Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045237.915148:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784045237.915163:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873760256 00000100:00100000:3.0:1784045237.915166:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873760256 00000100:00100000:3.0:1784045237.915187:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784045237.915192:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873760256:12345-0@lo:400: 00000100:00100000:3.0:1784045237.915217:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873760256:12345-0@lo:400: Request processed in 26us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045237.915223:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1784045237.915233:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784045237.915525:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873759744:0@lo:400: 00010000:00080000:1.0:1784045237.915536:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cc1376d80 x1870706873760256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045237.915545:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873760256:0@lo:400: 00010000:00080000:2.0:1784045237.922140:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cc1377800 x1870706873759616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045237.922159:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873759616:0@lo:400: 00000100:00100000:2.0:1784045237.922171:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873759488:0@lo:400: 00000100:00100000:2.0:1784045237.922227:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045237.922357:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045237.922366:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873760640:0@lo:13: 00000100:00100000:1.0:1784045237.922370:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873759488 00000100:00100000:1.0:1784045237.922378:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873759488 00000100:00100000:2.0:1784045237.922408:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045237.922468:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873760640 00000100:00100000:2.0:1784045237.922473:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873760640 00000100:00100000:1.0:1784045237.922477:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1784045237.922488:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:3626:x1870706873759488:12345-0@lo:400: 00000100:00100000:2.0:1784045237.922512:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784045237.922522:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873760640:12345-0@lo:13: 00000100:00100000:1.0:1784045237.922543:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:3626:x1870706873759488:12345-0@lo:400: Request processed in 56us (314us total) trans 0 rc 0/0 00002000:00000024:2.0:1784045237.922551:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045237.922552:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784045237.922602:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873760640:12345-0@lo:13: Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045237.922618:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784045237.922650:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82379180 x1870706873760640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045237.922664:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873760640:0@lo:13: 00000100:00100000:2.0:1784045237.922685:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873759488:0@lo:400: 00000100:00100000:0.0:1784045237.923569:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045237.923606:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873759872:0@lo:400: 00000100:00100000:0.0:1784045237.923642:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045237.923667:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873759360 00000100:00100000:2.0:1784045237.923674:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873759360 00000100:00100000:0.0:1784045237.923675:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873760384:0@lo:400: 00000100:00100000:0.0:1784045237.923706:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045237.923733:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784045237.923743:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873759360:12345-0@lo:13: 00000100:00100000:0.0:1784045237.923753:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873760384 00000100:00100000:0.0:1784045237.923758:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873760384 00002000:00000024:2.0:1784045237.923761:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045237.923792:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784045237.923799:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873759872 00000100:00100000:0.0:1784045237.923802:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1870706873760384:12345-0@lo:400: 00000100:00100000:1.0:1784045237.923803:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873759872 00000100:00100000:2.0:1784045237.923808:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1870706873759360:12345-0@lo:13: Request processed in 66us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045237.923817:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045237.923837:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1784045237.923839:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045237.923843:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873760384:12345-0@lo:400: Request processed in 43us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045237.923844:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873759872:12345-0@lo:400: 00000100:00100000:0.0:1784045237.923850:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784045237.923875:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873759872:12345-0@lo:400: Request processed in 32us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045237.923881:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1784045237.923887:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939c91562d80 x1870706873759360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045237.923902:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873759360:0@lo:13: 00010000:00080000:0.0:1784045237.923912:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cc1375500 x1870706873759872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045237.923920:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873759872:0@lo:400: 00010000:00080000:0.0:1784045237.923929:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cc1377480 x1870706873760384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045237.923935:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873760384:0@lo:400: 00010000:00010000:1.0:1784045238.228659:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045238.419812:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045238.419883:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873760768:0@lo:41: 00000100:00100000:2.0:1784045238.419959:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045238.420096:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873760768 00000100:00100000:0.0:1784045238.420111:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873760768 00000100:00100000:0.0:1784045238.420198:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784045238.420209:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873760768:12345-0@lo:41: 00000004:00000024:0.0:1784045238.420242:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1784045238.420305:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873760768:12345-0@lo:41: Request processed in 98us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045238.420314:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784045238.428189:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873760768:0@lo:41: 00010000:00010000:3.0:1784045239.252636:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045239.963115:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045239.963140:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873760896:0@lo:41: 00000100:00100000:0.0:1784045239.963203:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045239.963334:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873760896 00000100:00100000:3.0:1784045239.963342:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873760896 00000100:00100000:3.0:1784045239.963405:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784045239.963415:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873760896:12345-0@lo:41: 00000004:00000024:3.0:1784045239.963472:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1784045239.963537:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873760896:12345-0@lo:41: Request processed in 124us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045239.963556:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784045239.963601:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873760896:0@lo:41: 00010000:00010000:1.0:1784045240.276102:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045241.301221:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784045242.193724:0:9489:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784045242.193728:0:9489:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1784045242.193730:0:9489:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1784045242.193860:0:9489:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff939b82301000 00000020:01000004:1.0:1784045242.193877:0:9489:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1784045242.193892:0:9489:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784045242.193905:0:9489:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff939cb58b4d40) 00000020:00000080:1.0:1784045242.193922:0:9489:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784045242.245713:0:9489:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784045242.245792:0:9489:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1784045242.272402:0:9489:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784045242.272888:0:9489:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784045242.272902:0:9489:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784045242.272914:0:9489:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5475624df454c453 00000020:01000004:2.0:1784045242.272920:0:9489:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1784045242.272941:0:9489:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.144@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784045242.272945:0:9489:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784045242.272951:0:9489:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784045242.272995:0:9489:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1784045242.273000:0:9489:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1784045242.299512:0:9489:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784045242.299613:0:9489:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.144@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1784045242.299619:0:9489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784045242.299621:0:9489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784045242.299622:0:9489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045242.299623:0:9489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045242.299625:0:9489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045242.299626:0:9489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045242.299627:0:9489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784045242.299696:0:9489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784045242.299698:0:9489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784045242.299699:0:9489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045242.299700:0:9489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784045242.299704:0:9489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1784045242.299706:0:9489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784045242.299708:0:9489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784045242.299709:0:9489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045242.299710:0:9489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045242.299711:0:9489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045242.299712:0:9489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045242.299713:0:9489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784045242.299714:0:9489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784045242.299715:0:9489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784045242.299716:0:9489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045242.299718:0:9489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784045242.299802:0:9489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784045242.299820:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873761024:0@lo:253: 00000100:00100000:2.0:1784045242.299882:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045242.299972:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b82896900 going to sleep for 11 seconds 00000100:00100000:1.0:1784045242.301363:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873761024 00000100:00100000:1.0:1784045242.301409:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873761024 00000100:00100000:1.0:1784045242.301479:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784045242.301488:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:9489:x1870706873761024:12345-0@lo:253: 20000000:01000000:1.0:1784045242.301518:0:6488:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784045242.301530:0:6488:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1784045242.301535:0:6488:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1784045242.301538:0:6488:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1784045242.301983:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045242.302130:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1784045242.302146:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1784045242.302163:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1784045242.302168:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1784045242.302180:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1784045242.302193:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1784045242.302284:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1784045242.302299:0:6488:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.144@tcp 20000000:01000000:1.0:1784045242.302301:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:1.0:1784045242.302315:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1784045242.302320:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784045242.302333:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1784045242.302338:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:1.0:1784045242.302351:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1784045242.302365:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784045242.302390:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1784045242.302404:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1784045242.302488:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1784045242.302497:0:6488:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.144@tcp 20000000:01000000:1.0:1784045242.302499:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:1.0:1784045242.302510:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1784045242.302516:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784045242.302702:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1784045242.302710:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:1.0:1784045242.302723:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1784045242.302728:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784045242.302811:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1784045242.302830:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1784045242.303385:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1784045242.303400:0:6488:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.144@tcp 20000000:01000000:1.0:1784045242.303402:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.144@tcp (null) (null) (null) 00000040:00080000:1.0:1784045242.303415:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1784045242.303420:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784045242.303431:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1784045242.303436:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.144@tcp (null) (null) 00000040:00080000:1.0:1784045242.303476:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1784045242.303484:0:6488:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784045242.303497:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1784045242.303601:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1784045242.303617:0:6488:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784045242.303620:0:6488:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784045242.303623:0:6488:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1784045242.303910:0:6488:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784045242.303913:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784045242.304310:0:9495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1784045242.304629:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1784045242.304654:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1784045242.304768:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1784045242.304784:0:6488:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1784045242.304786:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784045242.306100:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1784045242.306135:0:9496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1784045242.306151:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1784045242.306350:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1784045242.306384:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1784045242.306401:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1784045242.306815:0:6488:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1784045242.306826:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784045242.307212:0:9497:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1784045242.307306:0:9497:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1784045242.307320:0:9497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1784045242.307938:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1784045242.307964:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1784045242.307981:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1784045242.307994:0:6488:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784045242.307996:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784045242.308405:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1784045242.308732:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1784045242.308763:0:9498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1784045242.308872:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1784045242.308894:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1784045242.308911:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1784045242.308923:0:6488:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784045242.308926:0:6488:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784045242.309897:0:9499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1784045242.309935:0:9499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1784045242.309948:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1784045242.310203:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1784045242.310224:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1784045242.310255:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:2.0:1784045242.310274:0:6488:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784045242.310293:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.310312:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc21fc200/0x5475624df454c350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c349 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.310387:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc106ea00/0x5475624df454c37a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c373 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.310397:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc2170200/0x5475624df454c3b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c3b2 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.310404:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc21fda00/0x5475624df454c3d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c3ce expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.310410:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c915aa200/0x5475624df454c3ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c3f8 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.310437:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c915aac00/0x5475624df454c41b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c414 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.310472:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c915ab600/0x5475624df454c43e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c437 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.310480:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.310515:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c915ab600/0x5475624df454c43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c437 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.310541:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c915ab600/0x5475624df454c43e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c437 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045242.310556:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873761152:0@lo:104: 00000100:00100000:2.0:1784045242.310615:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045242.310856:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c915aac00/0x5475624df454c41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c414 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.310864:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c915aac00/0x5475624df454c41b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c414 expref: 21 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045242.310873:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873761280:0@lo:104: 00000100:00100000:2.0:1784045242.310894:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045242.310918:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c915aa200/0x5475624df454c3ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c3f8 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.310926:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c915aa200/0x5475624df454c3ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c3f8 expref: 21 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045242.310941:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873761408:0@lo:104: 00000100:00100000:2.0:1784045242.310968:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045242.310983:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc21fda00/0x5475624df454c3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c3ce expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.310991:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc21fda00/0x5475624df454c3d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c3ce expref: 21 pid: 6488 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045242.311000:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873761536:0@lo:104: 00000100:00100000:2.0:1784045242.311019:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.311144:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873761152 00000100:00100000:1.0:1784045242.311151:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873761152 00000100:00100000:1.0:1784045242.311183:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873761280 00000100:00100000:1.0:1784045242.311185:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873761280 00000100:00100000:1.0:1784045242.311193:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873761408 00000100:00100000:1.0:1784045242.311195:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873761408 00000100:00100000:1.0:1784045242.311202:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873761536 00000100:00100000:1.0:1784045242.311204:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873761536 00000100:00100000:1.0:1784045242.311215:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784045242.311223:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+6:6488:x1870706873761152:12345-0@lo:104: 00010000:00010000:1.0:1784045242.311235:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c43e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.311286:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045242.311293:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+6:6488:x1870706873761152:12345-0@lo:104: Request processed in 71us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.311299:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784045242.311320:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784045242.311325:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:6488:x1870706873761280:12345-0@lo:104: 00010000:00010000:1.0:1784045242.311332:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c41b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.311364:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784045242.311379:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:6488:x1870706873761280:12345-0@lo:104: Request processed in 45us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.311385:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784045242.311398:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784045242.311404:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6488:x1870706873761408:12345-0@lo:104: 00010000:00010000:1.0:1784045242.311416:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c3ff expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.311463:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784045242.311469:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6488:x1870706873761408:12345-0@lo:104: Request processed in 66us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.311475:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784045242.311489:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784045242.311494:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6488:x1870706873761536:12345-0@lo:104: 00010000:00010000:1.0:1784045242.311501:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c3d5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.311538:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1784045242.311543:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6488:x1870706873761536:12345-0@lo:104: Request processed in 49us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.311549:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1784045242.311567:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784045242.311572:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c43e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.311579:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915abe00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045242.311582:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c43e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.311590:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c43e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045242.311597:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c43e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045242.311610:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045242.311880:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c43e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.311888:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045242.311908:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c43e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.311916:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915abe00/0x5475624df454c437 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c43e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.311930:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784045242.311933:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c41b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.311940:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045242.311943:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c41b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.311950:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c41b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045242.311955:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c41b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045242.311961:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045242.311974:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c41b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.311981:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045242.311993:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c41b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.312000:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c414 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c41b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.312010:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045242.312013:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c3ff expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.312020:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fd800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045242.312023:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c3ff expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.312030:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c3ff expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.312150:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc2170200/0x5475624df454c3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c3b2 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.312161:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc2170200/0x5475624df454c3b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c3b2 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045242.312172:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873761920:0@lo:104: 00000100:00100000:2.0:1784045242.312213:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045242.312268:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc106ea00/0x5475624df454c37a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c373 expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.312276:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc106ea00/0x5475624df454c37a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c373 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045242.312285:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873762048:0@lo:104: 00000100:00100000:2.0:1784045242.312308:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045242.312324:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc21fc200/0x5475624df454c350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c349 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.312342:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc21fc200/0x5475624df454c350 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c349 expref: 21 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045242.312350:0:6488:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873762176:0@lo:104: 00000100:00100000:2.0:1784045242.312379:0:6488:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b82896b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045242.312397:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873761152:0@lo:104: 00000100:00100000:2.0:1784045242.312404:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873761280:0@lo:104: 00000100:00100000:2.0:1784045242.312411:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873761408:0@lo:104: 00000100:00100000:2.0:1784045242.312417:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873761536:0@lo:104: 00010000:00010000:2.0:1784045242.312485:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045242.312490:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c3d5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.312496:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aba00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1784045242.312500:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c3d5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.312507:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c3d5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045242.312513:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c3d5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045242.312518:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784045242.312533:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c3d5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.312548:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045242.312571:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c3d5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.312577:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c3ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c3d5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.312587:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045242.312589:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045242.312590:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045242.312596:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045242.312671:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784045242.312691:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045242.312704:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873761920 00000100:00100000:0.0:1784045242.312709:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873761920 00000100:00100000:0.0:1784045242.312732:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873762048 00000100:00100000:0.0:1784045242.312863:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873762048 00000100:00100000:0.0:1784045242.312880:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873762176 00000100:00100000:0.0:1784045242.312888:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873762176 00000100:00100000:0.0:1784045242.312903:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784045242.312909:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:6488:x1870706873761920:12345-0@lo:104: 00010000:00010000:0.0:1784045242.312918:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c3b9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.312978:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784045242.312984:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:6488:x1870706873761920:12345-0@lo:104: Request processed in 76us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045242.312990:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784045242.313010:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784045242.313017:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb7b90c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6488:x1870706873762048:12345-0@lo:104: 00010000:00010000:0.0:1784045242.313025:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c37a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045242.313030:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873762304:0@lo:103: 00000100:00100000:3.0:1784045242.313062:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045242.313104:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873762304 00000100:00100000:3.0:1784045242.313108:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873762304 00010000:00010000:3.0:1784045242.313127:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc21fda00/0x5475624df454c3d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c3ce expref: 22 pid: 6488 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045242.313153:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784045242.313163:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1375880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:3623:x1870706873762304:12345-0@lo:103: 00010000:00010000:0.0:1784045242.313172:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1784045242.313174:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784045242.313181:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb7b90c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6488:x1870706873762048:12345-0@lo:104: Request processed in 164us (870us total) trans 0 rc 0/0 00010000:00010000:3.0:1784045242.313183:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc21fda00/0x5475624df454c3d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c3ce expref: 22 pid: 6488 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045242.313196:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1784045242.313200:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc21fda00/0x5475624df454c3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c3ce expref: 22 pid: 6488 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045242.313231:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784045242.313238:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6488:x1870706873762176:12345-0@lo:104: 00010000:00010000:0.0:1784045242.313246:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c350 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313273:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784045242.313277:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6488:x1870706873762176:12345-0@lo:104: Request processed in 41us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045242.313283:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1784045242.313313:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784045242.313318:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c3b9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313325:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fd600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1784045242.313329:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c3b9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313336:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c3b9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045242.313342:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c3b9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045242.313348:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045242.313378:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c3b9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313385:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045242.313399:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c3b9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313406:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc21fd600/0x5475624df454c3b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c3b9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313416:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784045242.313419:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c37a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313426:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fc400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1784045242.313428:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c37a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313441:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c37a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045242.313498:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c37a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045242.313503:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045242.313518:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c37a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313524:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045242.313529:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c37a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313535:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc21fc400/0x5475624df454c373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c37a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313545:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045242.313548:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c350 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313553:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1784045242.313556:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c350 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313562:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c350 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045242.313568:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c350 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045242.313578:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045242.313593:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c350 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313599:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045242.313603:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c350 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313610:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c349 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c350 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.313619:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045242.313622:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045242.313623:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045242.313632:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc21fda00/0x5475624df454c3d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c3ce expref: 22 pid: 6488 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.313647:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045242.313675:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1375880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:3623:x1870706873762304:12345-0@lo:103: Request processed in 515us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045242.313682:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 10000000:00010000:1.0:1784045242.313890:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c3ff expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045242.313898:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045242.313915:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c3ff expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.313920:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045242.313927:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c3ff expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.313933:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc21fd800/0x5475624df454c3f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c3ff expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.313947:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045242.313954:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045242.313956:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045242.313970:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873761664:0@lo:103: 00000100:00100000:1.0:1784045242.314001:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045242.314105:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873761664 00000100:00100000:3.0:1784045242.314110:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873761664 00010000:00010000:3.0:1784045242.314129:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c915ab600/0x5475624df454c43e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c437 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045242.314158:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784045242.314166:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:3625:x1870706873761664:12345-0@lo:103: 00010000:00010000:3.0:1784045242.314176:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045242.314180:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c915ab600/0x5475624df454c43e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c437 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.314190:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c915ab600/0x5475624df454c43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c437 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.314201:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915ab600/0x5475624df454c43e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c437 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.314291:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045242.314319:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:3625:x1870706873761664:12345-0@lo:103: Request processed in 154us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045242.314325:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784045242.314396:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873762560:0@lo:103: 00000100:00100000:1.0:1784045242.314423:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.314479:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873761664:0@lo:103: 00000100:00100000:1.0:1784045242.314493:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784045242.314501:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873761792:0@lo:103: 00000100:00100000:1.0:1784045242.314593:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.314606:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873762688:0@lo:103: 00000100:00100000:0.0:1784045242.314834:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873762432:0@lo:103: 00000100:00100000:0.0:1784045242.314866:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045242.314967:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873761920:0@lo:104: 00000100:00100000:2.0:1784045242.314978:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873762048:0@lo:104: 00000100:00100000:1.0:1784045242.315135:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.315166:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873762560 00000100:00100000:1.0:1784045242.315171:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873762560 00010000:00010000:1.0:1784045242.315191:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc106ea00/0x5475624df454c37a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c373 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045242.315208:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873761792 00000100:00100000:1.0:1784045242.315211:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873761792 00010000:00010000:1.0:1784045242.315222:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c915aac00/0x5475624df454c41b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c414 expref: 22 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045242.315245:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873762432 00000100:00100000:1.0:1784045242.315248:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873762432 00010000:00010000:1.0:1784045242.315260:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc2170200/0x5475624df454c3b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c3b2 expref: 23 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045242.315271:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873762688 00000100:00100000:1.0:1784045242.315273:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873762688 00010000:00010000:1.0:1784045242.315294:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc21fc200/0x5475624df454c350 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c349 expref: 24 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045242.315308:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784045242.315315:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873762560:12345-0@lo:103: 00010000:00010000:1.0:1784045242.315325:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045242.315330:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc106ea00/0x5475624df454c37a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c373 expref: 24 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.315338:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc106ea00/0x5475624df454c37a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c373 expref: 24 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.315352:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106ea00/0x5475624df454c37a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c373 expref: 24 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.315363:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045242.315407:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:3625:x1870706873762560:12345-0@lo:103: Request processed in 92us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.315414:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784045242.315434:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784045242.315441:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:3625:x1870706873761792:12345-0@lo:103: 00000100:00100000:0.0:1784045242.315544:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045242.315553:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873762816:0@lo:103: 00000100:00100000:0.0:1784045242.315580:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045242.315614:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873762304:0@lo:103: 00010000:00010000:0.0:1784045242.315867:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045242.318390:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045242.318406:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c915aac00/0x5475624df454c41b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c414 expref: 21 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045242.318410:0:6483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1784045242.318424:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1784045242.318429:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c915aac00/0x5475624df454c41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c414 expref: 21 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.318469:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915aac00/0x5475624df454c41b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c414 expref: 21 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045242.318470:0:6482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1784045242.318481:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873762816 00000100:00100000:3.0:1784045242.318488:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873762816 00010000:00010000:1.0:1784045242.318509:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045242.318514:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c915aa200/0x5475624df454c3ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c3f8 expref: 21 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045242.318536:0:6482:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1784045242.318545:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784045242.318552:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:3624:x1870706873762432:12345-0@lo:103: 00010000:00010000:3.0:1784045242.318561:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045242.318573:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc2170200/0x5475624df454c3b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c3b2 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.318581:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc2170200/0x5475624df454c3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c3b2 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.318593:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc2170200/0x5475624df454c3b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c3b2 expref: 21 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.318604:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045242.318673:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:3624:x1870706873762432:12345-0@lo:103: Request processed in 121us (3808us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045242.318681:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784045242.318896:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:3625:x1870706873761792:12345-0@lo:103: Request processed in 3454us (4301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.318906:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784045242.318954:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784045242.318962:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:3625:x1870706873762688:12345-0@lo:103: 00010000:00010000:1.0:1784045242.318970:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045242.318986:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc21fc200/0x5475624df454c350 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c349 expref: 19 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.318996:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc21fc200/0x5475624df454c350 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c349 expref: 19 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.319007:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045242.319029:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:3625:x1870706873762688:12345-0@lo:103: Request processed in 68us (3894us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.319157:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784045242.319174:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784045242.319181:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:3624:x1870706873762816:12345-0@lo:103: 00010000:00010000:1.0:1784045242.319189:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045242.319194:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c915aa200/0x5475624df454c3ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c3f8 expref: 18 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.319204:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c915aa200/0x5475624df454c3ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c3f8 expref: 18 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.319214:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915aa200/0x5475624df454c3ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c3f8 expref: 18 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.319243:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.319252:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.319265:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.319272:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.319279:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.319286:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.319292:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045242.319296:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.319303:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.319312:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.319323:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045242.319349:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:3624:x1870706873762816:12345-0@lo:103: Request processed in 169us (3768us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.319365:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784045242.319424:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873762688:0@lo:103: 00000100:00100000:1.0:1784045242.319435:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873762560:0@lo:103: 00000100:00100000:1.0:1784045242.319492:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873761792:0@lo:103: 00010000:00010000:2.0:1784045242.319841:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc21fc200/0x5475624df454c350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c349 expref: 16 pid: 6490 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045242.319857:0:6488:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6488:1870706873762176:0@lo:104: 00010000:00010000:2.0:1784045242.319902:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.319912:0:6488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045242.319914:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873762816:0@lo:103: 00010000:00010000:2.0:1784045242.319926:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045242.319931:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873762432:0@lo:103: 00010000:00010000:2.0:1784045242.319934:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81987000/0x5475624df454c45a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784045242.319962:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1784045242.324356:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:9489:x1870706873761024:12345-0@lo:253: Request processed in 22860us (24464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045242.324382:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00010000:0.0:1784045242.324535:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045242.324898:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873761024:0@lo:253: 10000000:01000000:3.0:1784045242.324916:0:9489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784045242.324920:0:9489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784045242.324922:0:9489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784045242.324923:0:9489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045242.324924:0:9489:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1784045242.324926:0:9489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045242.324927:0:9489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045242.324928:0:9489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045242.324930:0:9489:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784045242.324931:0:9489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045242.324932:0:9489:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784045242.324956:0:9489:0:(tgt_mount.c:101:server_register_mount()) register mount ffff939b82301000 from lustre-OST0001 10000000:01000000:3.0:1784045242.324988:0:9489:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1784045242.324991:0:9489:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784045242.325000:0:9489:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff939c901d3380 local copy 10000000:01000000:3.0:1784045242.325014:0:9489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784045242.325133:0:9489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.325145:0:9489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.325154:0:9489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045242.325173:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873762944:0@lo:101: 00000100:00100000:3.0:1784045242.325221:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045242.325365:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045242.325413:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873762944 00000100:00100000:0.0:1784045242.325420:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873762944 00000100:00100000:0.0:1784045242.325854:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784045242.325865:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:9489:x1870706873762944:12345-0@lo:101: 00010000:00010000:0.0:1784045242.325878:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045242.325899:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915ab400/0x5475624df454c468 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c461 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.325923:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915ab400/0x5475624df454c468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c461 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.325934:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915ab400/0x5475624df454c468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c461 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.325943:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915ab400, rc 0) 00000100:00100000:0.0:1784045242.325993:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:9489:x1870706873762944:12345-0@lo:101: Request processed in 131us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045242.325999:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1784045242.326073:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873762944:0@lo:101: 00010000:00010000:3.0:1784045242.326087:0:9489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5475624df454c468 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.326095:0:9489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5475624df454c468 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045242.326204:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763072:0@lo:501: 00000100:00100000:3.0:1784045242.326247:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045242.326433:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045242.326534:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873763072 00000100:00100000:1.0:1784045242.326540:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873763072 00000100:00100000:1.0:1784045242.326564:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1784045242.326570:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:9489:x1870706873763072:12345-0@lo:501: 00000100:00100000:1.0:1784045242.326644:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:9489:x1870706873763072:12345-0@lo:501: Request processed in 73us (397us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784045242.326651:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1784045242.326827:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763072:0@lo:501: 10000000:01000000:3.0:1784045242.326840:0:9489:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784045242.326860:0:9489:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784045242.326865:0:9489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5475624df454c468 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.326882:0:9489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5475624df454c468 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.326889:0:9489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5475624df454c468 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.326910:0:9489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784045242.326935:0:9489:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff939b82301000 10000000:01000000:3.0:1784045242.326940:0:9489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784045242.326945:0:9489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784045242.326948:0:9489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784045242.326952:0:9489:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1784045242.326955:0:9489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784045242.326971:0:9489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.326978:0:9489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.326985:0:9489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045242.326997:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763200:0@lo:101: 00000100:00100000:3.0:1784045242.327021:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045242.327056:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be480 going to sleep for 11 seconds 00010000:00010000:1.0:1784045242.327207:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045242.327213:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5475624df454c468 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.327221:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2170a00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045242.327224:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5475624df454c468 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.327300:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5475624df454c468 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045242.327307:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5475624df454c468 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045242.327313:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045242.327340:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5475624df454c468 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.327346:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045242.327381:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5475624df454c468 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.327389:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc2170a00/0x5475624df454c461 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5475624df454c468 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.327400:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045242.327402:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045242.327404:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045242.327411:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045242.327422:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873763328:0@lo:103: 00000100:00100000:1.0:1784045242.327472:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.327501:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873763328 00000100:00100000:1.0:1784045242.327506:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873763328 00000100:00100000:1.0:1784045242.327550:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784045242.327556:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:3623:x1870706873763328:12345-0@lo:103: 00010000:00010000:1.0:1784045242.327566:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045242.327577:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915ab400/0x5475624df454c468 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c461 expref: 15 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.327589:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045242.327616:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:3623:x1870706873763328:12345-0@lo:103: Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.327623:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784045242.327830:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873763328:0@lo:103: 00000100:00100000:2.0:1784045242.327932:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873763200 00000100:00100000:2.0:1784045242.327938:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873763200 00000100:00100000:2.0:1784045242.328000:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1784045242.328109:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+14:9489:x1870706873763200:12345-0@lo:101: 00010000:00010000:2.0:1784045242.328123:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045242.328139:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81987800/0x5475624df454c476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c46f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.328181:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987800/0x5475624df454c476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c46f expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.328203:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81987800/0x5475624df454c476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c46f expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.328209:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987800, rc 0) 00000100:00100000:2.0:1784045242.328330:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:9489:x1870706873763200:12345-0@lo:101: Request processed in 323us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045242.328336:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1784045242.328401:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763200:0@lo:101: 00010000:00010000:3.0:1784045242.328415:0:9489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c476 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.328437:0:9489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c476 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045242.328551:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763456:0@lo:501: 00000100:00100000:3.0:1784045242.328583:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045242.332786:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045242.332908:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873763456 00000100:00100000:1.0:1784045242.332932:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873763456 00000100:00100000:1.0:1784045242.332986:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1784045242.332995:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:9489:x1870706873763456:12345-0@lo:501: 00000100:00100000:1.0:1784045242.333215:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:9489:x1870706873763456:12345-0@lo:501: Request processed in 222us (4630us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.333224:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784045242.333399:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763456:0@lo:501: 00000100:00100000:3.0:1784045242.333473:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763584:0@lo:503: 00000100:00100000:3.0:1784045242.333595:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045242.333614:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045242.333831:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873763584 00000100:00100000:1.0:1784045242.333839:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873763584 00000100:00100000:1.0:1784045242.333875:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784045242.333882:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:9489:x1870706873763584:12345-0@lo:503: 00000100:00100000:1.0:1784045242.334019:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:9489:x1870706873763584:12345-0@lo:503: Request processed in 137us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.334026:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784045242.334196:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763584:0@lo:503: 00000040:00080000:3.0:1784045242.334827:0:9489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784045242.334906:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763712:0@lo:502: 00000100:00100000:3.0:1784045242.334953:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045242.334987:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be480 going to sleep for 11 seconds 00000100:00100000:0.0:1784045242.334998:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873763712 00000100:00100000:0.0:1784045242.335003:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873763712 00000100:00100000:0.0:1784045242.335037:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784045242.335045:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:9489:x1870706873763712:12345-0@lo:502: 00000100:00100000:0.0:1784045242.335138:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:9489:x1870706873763712:12345-0@lo:502: Request processed in 94us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045242.335146:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784045242.335171:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763712:0@lo:502: 00000040:00080000:3.0:1784045242.335614:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784045242.335650:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1784045242.335664:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1784045242.335693:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1784045242.335708:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1784045242.335722:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1784045242.335864:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763840:0@lo:502: 00000100:00100000:3.0:1784045242.335906:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045242.335975:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be480 going to sleep for 11 seconds 00000100:00100000:2.0:1784045242.336022:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873763840 00000100:00100000:2.0:1784045242.336027:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873763840 00000100:00100000:2.0:1784045242.336424:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784045242.336434:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:9489:x1870706873763840:12345-0@lo:502: 00000100:00100000:2.0:1784045242.336691:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:9489:x1870706873763840:12345-0@lo:502: Request processed in 257us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045242.336705:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1784045242.336844:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763840:0@lo:502: 00000040:00080000:3.0:1784045242.336908:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784045242.336919:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1784045242.337503:0:9501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784045242.337511:0:9501:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1784045242.337517:0:9501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045242.337520:0:9501:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1784045242.337598:0:9501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784045242.337613:0:9501:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff939b819b3380) 00000020:00000080:3.0:1784045242.337638:0:9501:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784045242.337644:0:9501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784045242.337730:0:9501:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939b82301000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1784045242.337804:0:9501:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784045242.337811:0:9501:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5475624df454c484 00010000:00010000:2.0:1784045242.349125:0:9501:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1784045242.350022:0:9501:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1784045242.359123:0:9501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784045242.361897:0:9501:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1784045242.370204:0:9501:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1784045242.371367:0:9501:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1784045242.381400:0:9501:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1784045242.384147:0:9501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1784045242.384160:0:9501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045242.384168:0:9501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045242.384170:0:9501:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1784045242.384174:0:9501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045242.384179:0:9501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045242.384181:0:9501:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784045242.384185:0:9501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784045242.384187:0:9501:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784045242.384216:0:9501:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045242.384220:0:9501:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045242.384221:0:9501:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784045242.384290:0:9501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1784045242.387149:0:9489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1784045242.387196:0:9489:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784045242.387221:0:9489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c476 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.387350:0:9489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c476 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045242.387359:0:9489:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939b82301000 from 1 10000000:01000000:0.0:1784045242.387384:0:9489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784045242.387422:0:9489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.387430:0:9489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.387441:0:9489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045242.387488:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763968:0@lo:101: 00000100:00100000:0.0:1784045242.387869:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045242.387920:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cbf431e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784045242.388108:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873763968 00000100:00100000:1.0:1784045242.388116:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873763968 00000100:00100000:1.0:1784045242.388168:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784045242.388177:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:9489:x1870706873763968:12345-0@lo:101: 00010000:00010000:1.0:1784045242.388189:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045242.388203:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106ea00/0x5475624df454c492 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c48b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.388223:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106ea00/0x5475624df454c492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c48b expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.388304:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106ea00/0x5475624df454c492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c48b expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.388313:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106ea00, rc 0) 00000100:00100000:1.0:1784045242.388573:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9489:x1870706873763968:12345-0@lo:101: Request processed in 396us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.388589:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784045242.392263:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873763968:0@lo:101: 00010000:00010000:2.0:1784045242.392294:0:9489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c492 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.392307:0:9489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c492 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045242.392470:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764096:0@lo:501: 00000100:00100000:2.0:1784045242.392538:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045242.392574:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b82896840 going to sleep for 11 seconds 00000100:00100000:3.0:1784045242.392928:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873764096 00000100:00100000:3.0:1784045242.392935:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873764096 00000100:00100000:3.0:1784045242.393131:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784045242.393141:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9489:x1870706873764096:12345-0@lo:501: 00000100:00100000:3.0:1784045242.393275:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9489:x1870706873764096:12345-0@lo:501: Request processed in 135us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045242.393283:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784045242.393355:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764096:0@lo:501: 00000100:00100000:2.0:1784045242.393409:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764224:0@lo:503: 00000100:00100000:2.0:1784045242.393475:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045242.397416:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b82896840 going to sleep for 11 seconds 00000100:00100000:1.0:1784045242.397938:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873764224 00000100:00100000:1.0:1784045242.397948:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873764224 00000100:00100000:1.0:1784045242.397993:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784045242.398002:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9489:x1870706873764224:12345-0@lo:503: 00000100:00100000:1.0:1784045242.398161:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9489:x1870706873764224:12345-0@lo:503: Request processed in 159us (4684us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.398171:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784045242.398298:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764224:0@lo:503: 00000040:00080000:2.0:1784045242.398795:0:9489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784045242.398879:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764352:0@lo:502: 00000100:00100000:2.0:1784045242.401954:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045242.402008:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b82896840 going to sleep for 11 seconds 00000100:00100000:3.0:1784045242.402068:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873764352 00000100:00100000:3.0:1784045242.402076:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873764352 00000100:00100000:3.0:1784045242.402123:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784045242.402131:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9489:x1870706873764352:12345-0@lo:502: 00000100:00100000:3.0:1784045242.402399:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9489:x1870706873764352:12345-0@lo:502: Request processed in 267us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045242.402413:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784045242.402725:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764352:0@lo:502: 00000040:00080000:2.0:1784045242.402950:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1784045242.402983:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1784045242.403014:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764480:0@lo:502: 00000100:00100000:2.0:1784045242.403189:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045242.403226:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b82896840 going to sleep for 11 seconds 00000100:00100000:0.0:1784045242.405861:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873764480 00000100:00100000:0.0:1784045242.405878:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873764480 00000100:00100000:0.0:1784045242.405953:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784045242.405963:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9489:x1870706873764480:12345-0@lo:502: 00000100:00100000:0.0:1784045242.406265:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9489:x1870706873764480:12345-0@lo:502: Request processed in 302us (3075us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045242.406273:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784045242.406535:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764480:0@lo:502: 00000040:00080000:2.0:1784045242.406623:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1784045242.406814:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1784045242.407590:0:9505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045242.407600:0:9505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045242.407602:0:9505:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784045242.407610:0:9505:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939b82301000 00000020:00000080:3.0:1784045242.407613:0:9505:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784045242.407625:0:9505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045242.408116:0:9505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045242.408119:0:9505:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784045242.408125:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1784045242.408359:0:9489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784045242.408399:0:9489:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784045242.408420:0:9489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c492 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.408431:0:9489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c492 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045242.408505:0:9489:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784045242.408508:0:9489:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff939b82301000 10000000:01000000:0.0:1784045242.408607:0:9489:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff939b82301000 10000000:01000000:0.0:1784045242.408612:0:9489:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784045242.408617:0:9489:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939b82301000 from 1 10000000:01000000:0.0:1784045242.408620:0:9489:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784045242.408725:0:9489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.408799:0:9489:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.408811:0:9489:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045242.408834:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764608:0@lo:101: 00000100:00100000:0.0:1784045242.408902:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045242.408991:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cbf431840 going to sleep for 11 seconds 00000100:00100000:3.0:1784045242.409933:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873764608 00000100:00100000:3.0:1784045242.409942:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873764608 00000100:00100000:3.0:1784045242.410152:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784045242.410164:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9489:x1870706873764608:12345-0@lo:101: 00010000:00010000:3.0:1784045242.410179:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045242.410195:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc2170200/0x5475624df454c4a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c499 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.410219:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc2170200/0x5475624df454c4a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c499 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.410241:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc2170200/0x5475624df454c4a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c499 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.410249:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2170200, rc 0) 00000100:00100000:3.0:1784045242.410348:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9489:x1870706873764608:12345-0@lo:101: Request processed in 186us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045242.410355:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784045242.413595:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764608:0@lo:101: 00010000:00010000:2.0:1784045242.413625:0:9489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c4a0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.413885:0:9489:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c4a0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045242.422271:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764736:0@lo:501: 00000100:00100000:0.0:1784045242.422347:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045242.423152:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cbf431780 going to sleep for 11 seconds 00000100:00100000:2.0:1784045242.423516:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873764736 00000100:00100000:2.0:1784045242.423526:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873764736 00000100:00100000:2.0:1784045242.423590:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784045242.423599:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9489:x1870706873764736:12345-0@lo:501: 00000100:00100000:2.0:1784045242.423764:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9489:x1870706873764736:12345-0@lo:501: Request processed in 166us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045242.423772:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784045242.423836:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764736:0@lo:501: 00000100:00100000:0.0:1784045242.423879:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764864:0@lo:503: 00000100:00100000:0.0:1784045242.423929:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045242.423959:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cbf431780 going to sleep for 11 seconds 00000100:00100000:3.0:1784045242.424001:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873764864 00000100:00100000:3.0:1784045242.424011:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873764864 00000100:00100000:3.0:1784045242.424122:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784045242.424131:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9489:x1870706873764864:12345-0@lo:503: 00000100:00100000:3.0:1784045242.424229:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9489:x1870706873764864:12345-0@lo:503: Request processed in 99us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045242.424235:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784045242.424329:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764864:0@lo:503: 00000040:00080000:1.0:1784045242.424987:0:9489:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784045242.425332:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764992:0@lo:502: 00000100:00100000:1.0:1784045242.425399:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.425425:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a60f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045242.430032:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873764992 00000100:00100000:2.0:1784045242.430051:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873764992 00000100:00100000:2.0:1784045242.430123:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784045242.430134:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9489:x1870706873764992:12345-0@lo:502: 00000100:00100000:2.0:1784045242.430359:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9489:x1870706873764992:12345-0@lo:502: Request processed in 227us (4960us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045242.430378:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784045242.430406:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873764992:0@lo:502: 00000040:00080000:0.0:1784045242.430716:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1784045242.430908:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1784045242.430925:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1784045242.430938:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1784045242.430963:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1784045242.430991:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1784045242.431006:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1784045242.431019:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1784045242.431163:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1784045242.431185:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1784045242.431200:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1784045242.431218:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1784045242.431230:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1784045242.431243:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1784045242.431255:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1784045242.431266:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1784045242.431279:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1784045242.431293:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1784045242.431306:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1784045242.431319:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1784045242.431335:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1784045242.431350:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1784045242.431364:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1784045242.431392:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1784045242.431405:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1784045242.431416:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1784045242.431504:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1784045242.431755:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1784045242.431774:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1784045242.431788:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1784045242.431802:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1784045242.431815:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1784045242.431827:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1784045242.431840:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1784045242.431852:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1784045242.431863:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1784045242.431875:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1784045242.431887:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1784045242.431900:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1784045242.431913:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1784045242.431926:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1784045242.431937:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1784045242.431963:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1784045242.431975:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1784045242.431988:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1784045242.432002:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1784045242.432043:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873765120:0@lo:502: 00000100:00100000:1.0:1784045242.432113:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.432156:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6f900 going to sleep for 11 seconds 00000100:00100000:0.0:1784045242.432221:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873765120 00000100:00100000:0.0:1784045242.432228:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873765120 00000100:00100000:0.0:1784045242.432278:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784045242.432287:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9489:x1870706873765120:12345-0@lo:502: 00000100:00100000:0.0:1784045242.432431:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9489:x1870706873765120:12345-0@lo:502: Request processed in 145us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045242.432439:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784045242.432568:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873765120:0@lo:502: 00000040:00080000:1.0:1784045242.432613:0:9489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1784045242.432622:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1784045242.438598:0:9506:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1784045242.438617:0:9506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff939b819b19c0) 00000020:00000080:3.0:1784045242.438644:0:9506:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:3.0:1784045242.438830:0:9506:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939b82301000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784045242.438834:0:9506:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939b82301000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784045242.438837:0:9506:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939b82301000 3 00010000:00080000:3.0:1784045242.438866:0:9506:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939b82a1c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1784045242.445749:0:9506:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:3.0:1784045242.445859:0:9506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1784045242.445901:0:9506:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784045242.445913:0:9506:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5475624df454c4ae 00000100:00080000:3.0:1784045242.445922:0:9506:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784045242.445928:0:9506:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff939b82a1c000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045242.445959:0:9506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939cc1374700 x1870706873765248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045242.445986:0:9506:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784045242.446381:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1870706873765248:0@lo:38: 00000100:00100000:1.0:1784045242.446477:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.446530:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873765504:0@lo:400: 00000100:00100000:1.0:1784045242.446557:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.446577:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873766016:0@lo:400: 00000100:00100000:1.0:1784045242.446599:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.446616:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784045242.446622:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873765376:0@lo:400: 00000100:00100000:1.0:1784045242.446641:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.446657:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873765888:0@lo:400: 00000100:00100000:1.0:1784045242.446676:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.446693:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873765632:0@lo:400: 00000100:00100000:1.0:1784045242.446714:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.446725:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873766144:0@lo:400: 00000100:00100000:1.0:1784045242.446748:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.446763:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784045242.446776:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873765760:0@lo:400: 00000100:00100000:1.0:1784045242.446799:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.446815:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873766272:0@lo:400: 00000100:00100000:1.0:1784045242.446834:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045242.446859:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873765504 00000100:00100000:1.0:1784045242.446866:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873765504 00000100:00100000:1.0:1784045242.446904:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873765760 00000100:00100000:1.0:1784045242.446907:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873765760 00000100:00100000:1.0:1784045242.446920:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784045242.446927:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873765504:12345-0@lo:400: 00000100:00100000:2.0:1784045242.447132:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873765248 00000100:00100000:2.0:1784045242.447137:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873765248 00000100:00100000:2.0:1784045242.447153:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873766016 00000100:00100000:2.0:1784045242.447155:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873766016 00000100:00100000:2.0:1784045242.447176:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873765376 00000100:00100000:2.0:1784045242.447178:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873765376 00000100:00100000:2.0:1784045242.447187:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873765888 00000100:00100000:2.0:1784045242.447189:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873765888 00000100:00100000:2.0:1784045242.447198:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873765632 00000100:00100000:2.0:1784045242.447200:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873765632 00000100:00100000:2.0:1784045242.447210:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784045242.447216:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873766016:12345-0@lo:400: 00000100:00100000:2.0:1784045242.447261:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873766016:12345-0@lo:400: Request processed in 45us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045242.447267:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784045242.447282:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784045242.447287:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873765376:12345-0@lo:400: 00000100:00100000:2.0:1784045242.447402:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873765376:12345-0@lo:400: Request processed in 114us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045242.447409:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784045242.447413:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873766144 00000100:00100000:3.0:1784045242.447418:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873766144 00000100:00100000:2.0:1784045242.447422:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784045242.447427:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873765888:12345-0@lo:400: 00000100:00100000:3.0:1784045242.447465:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873766272 00000100:00100000:3.0:1784045242.447468:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873766272 00000100:00100000:2.0:1784045242.447472:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873765888:12345-0@lo:400: Request processed in 46us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045242.447478:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784045242.447489:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045242.447489:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784045242.447495:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873766144:12345-0@lo:400: 00000100:00100000:2.0:1784045242.447495:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873765632:12345-0@lo:400: 00000100:00100000:2.0:1784045242.447528:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873765632:12345-0@lo:400: Request processed in 33us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045242.447532:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873766144:12345-0@lo:400: Request processed in 38us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045242.447533:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784045242.447538:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045242.447544:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784045242.447548:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784045242.447548:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873765248:12345-0@lo:38: 00000100:00100000:3.0:1784045242.447553:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873766272:12345-0@lo:400: 00010000:00080000:2.0:1784045242.447568:0:6496:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000100:00100000:3.0:1784045242.447576:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873766272:12345-0@lo:400: Request processed in 23us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045242.447581:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784045242.447597:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784045242.447603:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873765760:12345-0@lo:400: 00000020:00000080:2.0:1784045242.447609:0:6496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5475624df454c4b5 00000004:00100000:2.0:1784045242.447624:0:6496:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1784045242.447631:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873765760:12345-0@lo:400: Request processed in 28us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045242.447636:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000020:01000004:3.0:1784045242.447739:0:9506:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1784045242.447762:0:9506:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff939b832619c0) 00000020:00000080:3.0:1784045242.447779:0:9506:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1784045242.447913:0:9506:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939b82301000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784045242.447917:0:9506:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939b82301000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784045242.447920:0:9506:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939b82301000 3 00010000:00080000:3.0:1784045242.447946:0:9506:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939b82a1e800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.144@tcp at head 00000100:00080000:2.0:1784045242.449152:0:6496:0:(import.c:65:import_set_state_nolock()) ffff939c8fd2d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045242.449223:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1870706873765248:12345-0@lo:38: Request processed in 1672us (2745us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045242.449232:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1784045242.449260:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045242.449264:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045242.449266:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784045242.449403:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cc1374700 x1870706873765248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045242.449414:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784045242.449422:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1784045242.449430:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784045242.449434:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784045242.449436:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b82a1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784045242.449456:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1870706873765248:0@lo:38: 00000100:00100000:1.0:1784045242.449494:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873765760:0@lo:400: 00010000:00080000:1.0:1784045242.449508:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82a8dc00 x1870706873766272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045242.449518:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873766272:0@lo:400: 00010000:00080000:1.0:1784045242.449528:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82a8c380 x1870706873765632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045242.449536:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873765632:0@lo:400: 00010000:00080000:1.0:1784045242.449555:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82a8d880 x1870706873766144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045242.449563:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873766144:0@lo:400: 00000100:00100000:2.0:1784045242.449878:0:9508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8fb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9508:1870706873766400:0@lo:901: 00000100:00100000:2.0:1784045242.449926:0:9508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045242.449960:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873766400 00000100:00100000:2.0:1784045242.449965:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873766400 00010000:00080000:1.0:1784045242.450359:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82a8d500 x1870706873765376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045242.450380:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873765376:0@lo:400: 00010000:00080000:1.0:1784045242.450392:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82a8ed80 x1870706873765888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045242.450400:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873765888:0@lo:400: 00010000:00080000:1.0:1784045242.450410:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82a8f480 x1870706873766016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045242.450419:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873766016:0@lo:400: 00000100:00100000:1.0:1784045242.450479:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873765504:12345-0@lo:400: Request processed in 3551us (3920us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.450487:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784045242.450518:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873765504:0@lo:400: 00000100:00100000:2.0:1784045242.451189:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045242.451199:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9508:x1870706873766400:12345-0@lo:901: 00000100:00100000:2.0:1784045242.451305:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9508:x1870706873766400:12345-0@lo:901: Request processed in 108us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045242.451312:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1784045242.451340:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045242.451351:0:9508:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b82896a80 going to sleep for 11 seconds 00010000:00080000:2.0:1784045242.451376:0:9508:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82a8fb80 x1870706873766400/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784045258 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045242.451387:0:9508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8fb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9508:1870706873766400:0@lo:901: 00010000:00010000:3.0:1784045242.454064:0:9506:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1784045242.454163:0:9506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1784045242.454208:0:9506:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784045242.454232:0:9506:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5475624df454c4c3 00000100:00080000:3.0:1784045242.454243:0:9506:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784045242.454248:0:9506:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff939b82a1e800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045242.454302:0:9506:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939cc1374a80 x1870706873766528/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045242.454344:0:9506:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1784045242.455169:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1870706873766528:0@lo:38: 00000100:00100000:0.0:1784045242.455254:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045242.455314:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873766528 00000100:00100000:0.0:1784045242.455320:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873766528 00000100:00100000:0.0:1784045242.455357:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045242.455364:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873766528:12345-0@lo:38: 00010000:00080000:0.0:1784045242.455401:0:6496:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:0.0:1784045242.455441:0:6496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5475624df454c4ca 00000004:00100000:0.0:1784045242.455470:0:6496:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784045242.455513:0:6496:0:(import.c:65:import_set_state_nolock()) ffff939cb6808800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045242.455563:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1870706873766528:12345-0@lo:38: Request processed in 197us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045242.455571:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784045242.455606:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cc1374a80 x1870706873766528/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045242.455616:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784045242.455623:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1784045242.455903:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784045242.455910:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784045242.455913:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b82a1e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784045242.455920:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1870706873766528:0@lo:38: 00000040:00080000:3.0:1784045242.457065:0:9506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1784045242.457315:0:9489:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1784045242.457349:0:9489:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784045242.457382:0:9489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c4a0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.457393:0:9489:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c4a0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784045242.457566:0:9489:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784045242.457568:0:9489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784045242.457570:0:9489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045242.457571:0:9489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045242.457572:0:9489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045242.457574:0:9489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045242.457575:0:9489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784045242.457577:0:9489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784045242.457578:0:9489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784045242.457586:0:9489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045242.457587:0:9489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784045242.457591:0:9489:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1784045242.457593:0:9489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784045242.457595:0:9489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784045242.457595:0:9489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045242.457597:0:9489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045242.457597:0:9489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045242.457598:0:9489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045242.457599:0:9489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784045242.457600:0:9489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784045242.457601:0:9489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784045242.457602:0:9489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045242.457603:0:9489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784045242.457623:0:9489:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784045242.457640:0:9489:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873766656:0@lo:253: 00000100:00100000:2.0:1784045242.457712:0:9489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045242.457786:0:9489:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b82896180 going to sleep for 11 seconds 00000100:00100000:3.0:1784045242.457823:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873766656 00000100:00100000:3.0:1784045242.457830:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873766656 00000100:00100000:3.0:1784045242.457905:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784045242.457915:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9489:x1870706873766656:12345-0@lo:253: 20000000:01000000:3.0:1784045242.457939:0:6488:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784045242.457951:0:6488:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784045242.468313:0:6488:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784045242.468335:0:6488:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1784045242.468660:0:6512:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784045242.468665:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784045242.468687:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.468707:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c915aa000/0x5475624df454c3c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c3c0 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.468715:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c915aa800/0x5475624df454c40d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c406 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.468722:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.468762:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c915aa800/0x5475624df454c40d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c406 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.468793:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c915aa800/0x5475624df454c40d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c406 expref: 17 pid: 6488 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045242.468808:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873766784:0@lo:104: 00000100:00100000:2.0:1784045242.468871:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045242.468928:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c915aa000/0x5475624df454c3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c3c0 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045242.468937:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c915aa000/0x5475624df454c3c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c3c0 expref: 17 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045242.468945:0:6512:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873766912:0@lo:104: 00000100:00100000:2.0:1784045242.468966:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045242.468991:0:6512:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045242.469040:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873766784 00000100:00100000:1.0:1784045242.469048:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873766784 00000100:00100000:1.0:1784045242.469083:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873766912 00000100:00100000:1.0:1784045242.469085:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873766912 00000100:00100000:1.0:1784045242.469097:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784045242.469105:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6512:x1870706873766784:12345-0@lo:104: 00010000:00010000:1.0:1784045242.469116:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c40d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.469185:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045242.469191:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:6512:x1870706873766784:12345-0@lo:104: Request processed in 87us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.469198:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784045242.469221:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784045242.469228:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6512:x1870706873766912:12345-0@lo:104: 00010000:00010000:1.0:1784045242.469235:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c3c7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045242.469265:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784045242.469270:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:6512:x1870706873766912:12345-0@lo:104: Request processed in 44us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045242.469276:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784045242.469419:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9489:x1870706873766656:12345-0@lo:253: Request processed in 11505us (11706us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045242.469427:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784045242.469560:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873766784:0@lo:104: 00000100:00100000:2.0:1784045242.469570:0:6512:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6512:1870706873766912:0@lo:104: 00010000:00010000:2.0:1784045242.469591:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045242.469737:0:9489:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0e855152-ca69-43a0-b465-3bf4e35d62f0:9489:1870706873766656:0@lo:253: 10000000:01000000:1.0:1784045242.469747:0:9489:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784045242.469750:0:9489:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784045242.469752:0:9489:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784045242.469753:0:9489:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784045242.469754:0:9489:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784045242.469755:0:9489:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784045242.469756:0:9489:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784045242.469757:0:9489:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784045242.469759:0:9489:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784045242.469760:0:9489:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784045242.469762:0:9489:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784045242.469763:0:9489:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784045242.469776:0:9489:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1784045242.470086:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784045242.470093:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c40d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.470102:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915ab800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1784045242.470106:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c40d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.470123:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c40d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045242.470130:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c40d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045242.470136:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784045242.470165:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c40d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.470170:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045242.470202:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c40d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.470209:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c406 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c40d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.470221:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045242.470224:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c3c7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.470230:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fd000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1784045242.470233:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c3c7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.470240:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c3c7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045242.470246:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c3c7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045242.470258:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1784045242.470673:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873767040:0@lo:103: 00000100:00100000:2.0:1784045242.470723:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045242.470841:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873767040 00000100:00100000:3.0:1784045242.470846:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873767040 00010000:00010000:3.0:1784045242.470871:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c915aa800/0x5475624df454c40d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c406 expref: 17 pid: 6488 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045242.470899:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784045242.470907:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:3625:x1870706873767040:12345-0@lo:103: 00010000:00010000:3.0:1784045242.470919:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045242.470924:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c915aa800/0x5475624df454c40d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c406 expref: 17 pid: 6488 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.470934:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c915aa800/0x5475624df454c40d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c406 expref: 17 pid: 6488 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.470949:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915aa800/0x5475624df454c40d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c406 expref: 17 pid: 6488 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045242.470974:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045242.471011:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:3625:x1870706873767040:12345-0@lo:103: Request processed in 105us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045242.471017:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784045242.471046:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873767040:0@lo:103: 00010000:00010000:0.0:1784045242.471118:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c3c7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.471125:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045242.471140:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c3c7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.471147:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c3c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c3c7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.471160:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045242.471162:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045242.471164:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045242.471170:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045242.471182:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873767168:0@lo:103: 00000100:00100000:0.0:1784045242.471210:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045242.471244:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873767168 00000100:00100000:0.0:1784045242.471248:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873767168 00010000:00010000:0.0:1784045242.471263:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c915aa000/0x5475624df454c3c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c3c0 expref: 16 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045242.471282:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784045242.471288:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:3626:x1870706873767168:12345-0@lo:103: 00010000:00010000:0.0:1784045242.471296:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045242.471300:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c915aa000/0x5475624df454c3c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c3c0 expref: 16 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.471308:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c915aa000/0x5475624df454c3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c3c0 expref: 16 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.471326:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915aa000/0x5475624df454c3c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c3c0 expref: 16 pid: 6489 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.471337:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.471345:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784045242.471359:0:6481:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003759372s 00010000:00010000:0.0:1784045242.471364:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.472227:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.472235:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.472241:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.472246:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:0.0:1784045242.472250:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.472257:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.472285:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.472309:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045242.472357:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:3626:x1870706873767168:12345-0@lo:103: Request processed in 1067us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045242.472365:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784045242.472421:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873767168:0@lo:103: 00010000:00010000:0.0:1784045242.472456:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.472464:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045242.472469:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81987000/0x5475624df454c4d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1784045242.479117:0:9489:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1784045242.479304:0:9489:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1784045242.479753:0:9489:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1784045242.479922:0:9489:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1784045242.480159:0:9489:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1784045242.480392:0:9489:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1784045242.481691:0:9489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1784045242.497565:0:9489:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1784045242.497577:0:9489:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1784045242.497623:0:9489:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784045242.497683:0:9489:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784045242.497703:0:9489:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1784045242.497724:0:9489:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1784045242.498565:0:9489:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045242.498814:0:9489:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1784045243.030897:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045243.030924:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873767424:0@lo:13: 00000100:00100000:3.0:1784045243.031004:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045243.031065:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873767296:0@lo:13: 00000100:00100000:3.0:1784045243.031088:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045243.031122:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873767424 00000100:00100000:3.0:1784045243.031129:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873767424 00000100:00100000:3.0:1784045243.031165:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873767296 00000100:00100000:3.0:1784045243.031168:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873767296 00000100:00100000:3.0:1784045243.031185:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045243.031194:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873767424:12345-0@lo:13: 00000100:00100000:2.0:1784045243.031196:0:8416:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1784045243.031207:0:8416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1784045243.031226:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045243.031272:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873767424:12345-0@lo:13: Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045243.031280:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045243.031299:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784045243.031306:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873767296:12345-0@lo:13: 00002000:00000024:3.0:1784045243.031319:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045243.031346:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873767296:12345-0@lo:13: Request processed in 42us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045243.031351:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1784045243.031418:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82a8e300 x1870706873767424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045243.031435:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873767424:0@lo:13: 00010000:00080000:3.0:1784045243.031473:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cc1376300 x1870706873767296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045243.031484:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873767296:0@lo:13: 00010000:00010000:1.0:1784045243.349091:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784045243.431064:0:9563:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784045243.431415:0:9563:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784045243.540216:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873767552:0@lo:41: 00000100:00100000:3.0:1784045243.540328:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045243.540412:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873767552 00000100:00100000:3.0:1784045243.540421:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873767552 00000100:00100000:3.0:1784045243.540499:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784045243.540508:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873767552:12345-0@lo:41: 00000004:00000024:3.0:1784045243.540540:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1784045243.540587:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873767552:12345-0@lo:41: Request processed in 80us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045243.540594:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784045243.540654:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873767552:0@lo:41: 00010000:00010000:0.0:1784045244.374538:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045245.076642:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873767680:0@lo:41: 00000100:00100000:2.0:1784045245.076712:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045245.076800:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873767680 00000100:00100000:2.0:1784045245.076807:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873767680 00000100:00100000:2.0:1784045245.076854:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784045245.076864:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873767680:12345-0@lo:41: 00000004:00000024:2.0:1784045245.076899:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1784045245.076944:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873767680:12345-0@lo:41: Request processed in 83us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045245.076952:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784045245.077009:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873767680:0@lo:41: 00010000:00010000:0.0:1784045245.395677:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045246.434614:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045247.445783:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045247.641497:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873767936:0@lo:400: 00000100:00100000:0.0:1784045247.641558:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045247.641607:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873768448:0@lo:400: 00000100:00100000:0.0:1784045247.641624:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045247.641641:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873768960:0@lo:400: 00000100:00100000:0.0:1784045247.641659:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045247.641679:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784045247.641684:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873767808:0@lo:400: 00000100:00100000:0.0:1784045247.641706:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045247.641723:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873768320:0@lo:400: 00000100:00100000:0.0:1784045247.641741:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045247.641754:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873768832:0@lo:400: 00000100:00100000:0.0:1784045247.641770:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045247.641790:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873768064:0@lo:400: 00000100:00100000:0.0:1784045247.641809:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045247.641822:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873768576:0@lo:400: 00000100:00100000:0.0:1784045247.641840:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045247.641850:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873769088:0@lo:400: 00000100:00100000:0.0:1784045247.641867:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045247.641877:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784045247.641881:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873768192:0@lo:400: 00000100:00100000:0.0:1784045247.641897:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045247.641905:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873768704:0@lo:400: 00000100:00100000:0.0:1784045247.641919:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045247.641944:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873767936 00000100:00100000:0.0:1784045247.641955:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873767936 00000100:00100000:0.0:1784045247.641984:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873768448 00000100:00100000:0.0:1784045247.641986:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873768448 00000100:00100000:0.0:1784045247.642003:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873768960 00000100:00100000:0.0:1784045247.642005:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873768960 00000100:00100000:0.0:1784045247.642014:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873768576 00000100:00100000:0.0:1784045247.642016:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873768576 00000100:00100000:0.0:1784045247.642025:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873769088 00000100:00100000:0.0:1784045247.642027:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873769088 00000100:00100000:0.0:1784045247.642034:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873768192 00000100:00100000:0.0:1784045247.642036:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873768192 00000100:00100000:0.0:1784045247.642047:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784045247.642053:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873767936:12345-0@lo:400: 00000100:00100000:0.0:1784045247.642095:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873767936:12345-0@lo:400: Request processed in 42us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045247.642102:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784045247.642116:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784045247.642121:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873768448:12345-0@lo:400: 00000100:00100000:0.0:1784045247.642141:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873768448:12345-0@lo:400: Request processed in 20us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045247.642146:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784045247.642154:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784045247.642158:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873768960:12345-0@lo:400: 00000100:00100000:0.0:1784045247.642176:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873768960:12345-0@lo:400: Request processed in 18us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045247.642181:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784045247.642188:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784045247.642193:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873768576:12345-0@lo:400: 00000100:00100000:0.0:1784045247.642213:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873768576:12345-0@lo:400: Request processed in 20us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045247.642224:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784045247.642233:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784045247.642238:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873769088:12345-0@lo:400: 00000100:00100000:0.0:1784045247.642260:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873769088:12345-0@lo:400: Request processed in 22us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045247.642265:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784045247.642289:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784045247.642295:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873768192:12345-0@lo:400: 00000100:00100000:0.0:1784045247.642316:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873768192:12345-0@lo:400: Request processed in 22us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045247.642322:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784045247.642346:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873767808 00000100:00100000:0.0:1784045247.642349:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873767808 00000100:00100000:0.0:1784045247.642372:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784045247.642377:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:3624:x1870706873767808:12345-0@lo:400: 00000100:00100000:0.0:1784045247.642404:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:3624:x1870706873767808:12345-0@lo:400: Request processed in 26us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045247.642410:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784045247.642435:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873768320 00000100:00100000:0.0:1784045247.642439:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873768320 00000100:00100000:0.0:1784045247.642486:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873768064 00000100:00100000:0.0:1784045247.642490:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873768064 00000100:00100000:0.0:1784045247.642501:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784045247.642506:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873768320:12345-0@lo:400: 00000100:00100000:0.0:1784045247.642537:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873768320:12345-0@lo:400: Request processed in 30us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045247.642553:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784045247.642566:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784045247.642571:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873768064:12345-0@lo:400: 00000100:00100000:0.0:1784045247.642598:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873768064:12345-0@lo:400: Request processed in 27us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045247.642604:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784045247.642621:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873768832 00000100:00100000:0.0:1784045247.642624:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873768832 00000100:00100000:0.0:1784045247.642650:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873768704 00000100:00100000:0.0:1784045247.642653:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873768704 00000100:00100000:0.0:1784045247.642671:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045247.642677:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873768832:12345-0@lo:400: 00000100:00100000:0.0:1784045247.642705:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873768832:12345-0@lo:400: Request processed in 29us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045247.642711:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045247.642724:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045247.642729:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873768704:12345-0@lo:400: 00000100:00100000:0.0:1784045247.642770:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873768704:12345-0@lo:400: Request processed in 41us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045247.642777:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1784045247.642799:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045247.642804:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784045247.642806:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784045247.642843:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820e300 x1870706873768192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045247.642857:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873768192:0@lo:400: 00010000:00080000:0.0:1784045247.642877:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915b8a80 x1870706873768704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045247.642885:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873768704:0@lo:400: 00000100:00100000:0.0:1784045247.642894:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873768064:0@lo:400: 00010000:00080000:0.0:1784045247.642903:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915bb800 x1870706873768576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045247.642910:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873768576:0@lo:400: 00010000:00080000:0.0:1784045247.642919:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82882a00 x1870706873769088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045247.642926:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873769088:0@lo:400: 00000100:00100000:0.0:1784045247.642963:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873767808:0@lo:400: 00000100:00100000:0.0:1784045247.642972:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873768320:0@lo:400: 00010000:00080000:0.0:1784045247.642982:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915b9500 x1870706873768832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045247.642990:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873768832:0@lo:400: 00010000:00080000:0.0:1784045247.642999:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820e680 x1870706873767936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045247.643007:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873767936:0@lo:400: 00010000:00080000:0.0:1784045247.643016:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915ba680 x1870706873768448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045247.643024:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873768448:0@lo:400: 00010000:00080000:0.0:1784045247.643044:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915bad80 x1870706873768960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045247.643052:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873768960:0@lo:400: 00000100:00100000:0.0:1784045248.149426:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873769216:0@lo:13: 00000100:00100000:0.0:1784045248.149534:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045248.149594:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873769216 00000100:00100000:3.0:1784045248.149615:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873769216 00000100:00100000:3.0:1784045248.149705:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045248.149718:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873769216:12345-0@lo:13: 00002000:00000024:3.0:1784045248.149762:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045248.149859:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873769216:12345-0@lo:13: Request processed in 143us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045248.149869:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1784045248.150055:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc1375f80 x1870706873769216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045248.150081:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873769216:0@lo:13: 00000100:00100000:0.0:1784045248.150101:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045248.150108:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873769344:0@lo:13: 00000100:00100000:0.0:1784045248.150139:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045248.150303:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873769344 00000100:00100000:2.0:1784045248.150311:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873769344 00000100:00100000:2.0:1784045248.150372:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045248.150382:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873769344:12345-0@lo:13: 00002000:00000024:2.0:1784045248.150404:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045248.150469:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873769344:12345-0@lo:13: Request processed in 87us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045248.150476:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1784045248.150540:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8ce00 x1870706873769344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045248.150552:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873769344:0@lo:13: 00010000:00010000:0.0:1784045248.467727:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045248.667753:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873769472:0@lo:41: 00000100:00100000:1.0:1784045248.667825:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045248.668352:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873769472 00000100:00100000:0.0:1784045248.668360:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873769472 00000100:00100000:0.0:1784045248.668500:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784045248.668510:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873769472:12345-0@lo:41: 00000004:00000024:0.0:1784045248.668545:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1784045248.668604:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873769472:12345-0@lo:41: Request processed in 97us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045248.668611:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784045248.668653:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873769472:0@lo:41: 00000001:02000400:2.0:1784045248.743146:0:9852:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784045249.494316:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784045249.881788:0:9905:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045249.882223:0:9905:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1784045250.196546:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784045250.196565:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939cc10ba000 from 39 10000000:01000000:3.0:1784045250.196572:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784045250.196913:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.196929:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.196941:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045250.196970:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873769600:0@lo:101: 00000100:00100000:3.0:1784045250.197433:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.197511:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b180 going to sleep for 11 seconds 00000100:00100000:3.0:1784045250.197535:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873769600 00000100:00100000:3.0:1784045250.197543:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873769600 00000100:00100000:1.0:1784045250.197644:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873769728:0@lo:41: 00000100:00100000:1.0:1784045250.197695:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.197733:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784045250.197743:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873769600:12345-0@lo:101: 00010000:00010000:3.0:1784045250.197762:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045250.197782:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc2170a00/0x5475624df454c4df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c4d8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045250.197834:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873769728 00000100:00100000:0.0:1784045250.197840:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873769728 00010000:00010000:3.0:1784045250.197880:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc2170a00/0x5475624df454c4df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c4d8 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.197894:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc2170a00/0x5475624df454c4df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c4d8 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.197905:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2170a00, rc 0) 00000100:00100000:0.0:1784045250.197917:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784045250.197927:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873769728:12345-0@lo:41: 00000100:00100000:3.0:1784045250.197952:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873769600:12345-0@lo:101: Request processed in 209us (520us total) trans 0 rc 0/0 00000004:00000024:0.0:1784045250.197962:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1784045250.197975:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784045250.198144:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873769728:12345-0@lo:41: Request processed in 217us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.198151:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784045250.198226:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873769728:0@lo:41: 00000100:00100000:0.0:1784045250.198548:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1375180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873769600:0@lo:101: 00010000:00010000:0.0:1784045250.198568:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c4df expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045250.198581:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c4df expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045250.198663:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873769856:0@lo:501: 00000100:00100000:0.0:1784045250.198711:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045250.198753:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045250.198834:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873769856 00000100:00100000:1.0:1784045250.198840:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873769856 00000100:00100000:1.0:1784045250.198881:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784045250.198892:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873769856:12345-0@lo:501: 00000100:00100000:1.0:1784045250.199077:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873769856:12345-0@lo:501: Request processed in 188us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.199086:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784045250.199234:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873769856:0@lo:501: 00000100:00100000:0.0:1784045250.199269:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873769984:0@lo:503: 00000100:00100000:0.0:1784045250.199314:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045250.199346:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045250.199673:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873769984 00000100:00100000:3.0:1784045250.199679:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873769984 00000100:00100000:3.0:1784045250.199715:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784045250.199724:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873769984:12345-0@lo:503: 00000100:00100000:3.0:1784045250.199900:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873769984:12345-0@lo:503: Request processed in 176us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045250.199907:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784045250.199946:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873769984:0@lo:503: 00000100:00100000:3.0:1784045250.207534:0:9924:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9924:1870706873770112:0@lo:502: 00000100:00100000:3.0:1784045250.207658:0:9924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.207721:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873770112 00000100:00100000:3.0:1784045250.207725:0:9924:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045250.207731:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873770112 00000100:00100000:2.0:1784045250.207804:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784045250.207827:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9924:x1870706873770112:12345-0@lo:502: 00000100:00100000:2.0:1784045250.208009:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9924:x1870706873770112:12345-0@lo:502: Request processed in 184us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045250.208019:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784045250.208072:0:9924:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9924:1870706873770112:0@lo:502: 00000100:00100000:0.0:1784045250.208133:0:9924:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9924:1870706873770240:0@lo:502: 00000100:00100000:0.0:1784045250.208172:0:9924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045250.208208:0:9924:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6f240 going to sleep for 11 seconds 00000100:00100000:2.0:1784045250.208251:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873770240 00000100:00100000:2.0:1784045250.208256:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873770240 00000100:00100000:2.0:1784045250.208296:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784045250.208303:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9924:x1870706873770240:12345-0@lo:502: 00000100:00100000:2.0:1784045250.208391:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:9924:x1870706873770240:12345-0@lo:502: Request processed in 88us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045250.208398:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784045250.208565:0:9924:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9924:1870706873770240:0@lo:502: 00000040:00080000:0.0:1784045250.208589:0:9924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1784045250.208683:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1784045250.208717:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784045250.208731:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c4df expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.208746:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c4df expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045250.208759:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784045250.208763:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1784045250.208766:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784045250.208809:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.208818:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.208828:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045250.208844:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873770368:0@lo:101: 00000100:00100000:2.0:1784045250.208876:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.208909:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045250.208928:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873770368 00000100:00100000:1.0:1784045250.208935:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873770368 00000100:00100000:1.0:1784045250.209090:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784045250.209100:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873770368:12345-0@lo:101: 00010000:00010000:1.0:1784045250.209111:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045250.209126:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106e000/0x5475624df454c4ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c4e6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045250.209154:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106e000/0x5475624df454c4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c4e6 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045250.209181:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106e000/0x5475624df454c4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c4e6 expref: 17 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045250.209192:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106e000, rc 0) 00000100:00100000:1.0:1784045250.209239:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873770368:12345-0@lo:101: Request processed in 140us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.209245:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784045250.209333:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873770368:0@lo:101: 00010000:00010000:2.0:1784045250.209359:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c4ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.209371:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c4ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045250.209427:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873770496:0@lo:501: 00000100:00100000:2.0:1784045250.209490:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.209513:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045250.209729:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873770496 00000100:00100000:1.0:1784045250.209735:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873770496 00000100:00100000:1.0:1784045250.209768:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784045250.209776:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873770496:12345-0@lo:501: 00000100:00100000:1.0:1784045250.209927:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873770496:12345-0@lo:501: Request processed in 151us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.209935:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784045250.210105:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873770496:0@lo:501: 00000100:00100000:3.0:1784045250.210144:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873770624:0@lo:503: 00000100:00100000:3.0:1784045250.210190:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.210215:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045250.210263:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873770624 00000100:00100000:1.0:1784045250.210268:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873770624 00000100:00100000:1.0:1784045250.210339:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784045250.210347:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873770624:12345-0@lo:503: 00000100:00100000:1.0:1784045250.210961:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873770624:12345-0@lo:503: Request processed in 611us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.210969:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784045250.211117:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873770624:0@lo:503: 00000100:00100000:1.0:1784045250.211672:0:9926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9926:1870706873770752:0@lo:502: 00000100:00100000:1.0:1784045250.211888:0:9926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045250.211961:0:9926:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81300 going to sleep for 11 seconds 00000100:00100000:0.0:1784045250.212245:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873770752 00000100:00100000:0.0:1784045250.212253:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873770752 00000100:00100000:0.0:1784045250.212338:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784045250.212347:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9926:x1870706873770752:12345-0@lo:502: 00000100:00100000:0.0:1784045250.212647:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9926:x1870706873770752:12345-0@lo:502: Request processed in 300us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.212654:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784045250.212742:0:9926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9926:1870706873770752:0@lo:502: 00000020:01000000:1.0:1784045250.212771:0:9926:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045250.212788:0:9926:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045250.212791:0:9926:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784045250.212797:0:9926:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784045250.212799:0:9926:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784045250.212821:0:9926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9926:1870706873770880:0@lo:502: 00000100:00100000:1.0:1784045250.212863:0:9926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045250.212994:0:9926:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81300 going to sleep for 11 seconds 00000100:00100000:3.0:1784045250.213074:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873770880 00000100:00100000:3.0:1784045250.213082:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873770880 00000100:00100000:3.0:1784045250.213110:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784045250.213117:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9926:x1870706873770880:12345-0@lo:502: 00000100:00100000:3.0:1784045250.213206:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:9926:x1870706873770880:12345-0@lo:502: Request processed in 90us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045250.213212:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784045250.213336:0:9926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9926:1870706873770880:0@lo:502: 00000020:01000000:1.0:1784045250.213355:0:9926:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045250.213360:0:9926:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045250.213361:0:9926:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784045250.213365:0:9926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1784045250.213731:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1784045250.213763:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784045250.213775:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c4ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.213794:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c4ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045250.213806:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784045250.213809:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939c9157c000 from 39 10000000:01000000:3.0:1784045250.213812:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784045250.213845:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.213854:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.213864:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045250.213886:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873771008:0@lo:101: 00000100:00100000:3.0:1784045250.213924:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.213959:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045250.214063:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873771008 00000100:00100000:1.0:1784045250.214069:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873771008 00000100:00100000:1.0:1784045250.214092:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784045250.214100:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873771008:12345-0@lo:101: 00010000:00010000:1.0:1784045250.214111:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045250.214125:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106fa00/0x5475624df454c4fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c4f4 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045250.214151:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106fa00/0x5475624df454c4fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c4f4 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045250.214162:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106fa00/0x5475624df454c4fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c4f4 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045250.214172:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106fa00, rc 0) 00000100:00100000:1.0:1784045250.214217:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873771008:12345-0@lo:101: Request processed in 118us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.214223:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784045250.214307:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873771008:0@lo:101: 00010000:00010000:3.0:1784045250.214335:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c4fb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.214345:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c4fb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045250.219299:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873771136:0@lo:501: 00000100:00100000:3.0:1784045250.219417:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045250.220042:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873771136 00000100:00100000:1.0:1784045250.220054:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873771136 00000100:00100000:1.0:1784045250.220123:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784045250.220133:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873771136:12345-0@lo:501: 00000100:00100000:1.0:1784045250.221031:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873771136:12345-0@lo:501: Request processed in 893us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.221043:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784045250.223753:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b480 going to sleep for 11 seconds 00000100:00100000:3.0:1784045250.223814:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873771136:0@lo:501: 00000100:00100000:3.0:1784045250.223894:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873771264:0@lo:503: 00000100:00100000:3.0:1784045250.224000:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.224034:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045250.224252:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873771264 00000100:00100000:1.0:1784045250.224262:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873771264 00000100:00100000:1.0:1784045250.224340:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784045250.224354:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873771264:12345-0@lo:503: 00000100:00100000:1.0:1784045250.224559:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873771264:12345-0@lo:503: Request processed in 207us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.224568:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784045250.224647:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873771264:0@lo:503: 00000100:00100000:3.0:1784045250.225357:0:9927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9927:1870706873771392:0@lo:502: 00000100:00100000:3.0:1784045250.225431:0:9927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.225506:0:9927:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045250.225630:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873771392 00000100:00100000:2.0:1784045250.225638:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873771392 00000100:00100000:1.0:1784045250.225683:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784045250.225696:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:9927:x1870706873771392:12345-0@lo:502: 00000100:00100000:1.0:1784045250.225812:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:9927:x1870706873771392:12345-0@lo:502: Request processed in 119us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.225820:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784045250.225902:0:9927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9927:1870706873771392:0@lo:502: 00000100:00100000:3.0:1784045250.225951:0:9927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9927:1870706873771520:0@lo:502: 00000100:00100000:3.0:1784045250.226055:0:9927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.226080:0:9927:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92c48480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045250.226118:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873771520 00000100:00100000:1.0:1784045250.226122:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873771520 00000100:00100000:1.0:1784045250.226154:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784045250.226160:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:9927:x1870706873771520:12345-0@lo:502: 00000100:00100000:1.0:1784045250.226225:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:9927:x1870706873771520:12345-0@lo:502: Request processed in 64us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.226231:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784045250.226305:0:9927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9927:1870706873771520:0@lo:502: 00000040:00080000:3.0:1784045250.226333:0:9927:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1784045250.226721:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1784045250.226750:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784045250.226764:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c4fb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.226777:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c4fb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045250.226788:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784045250.226792:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939c9157c000 from 6 10000000:01000000:2.0:1784045250.226795:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784045250.226903:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.226914:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.226926:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045250.226950:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873771648:0@lo:101: 00000100:00100000:2.0:1784045250.227239:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.227343:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045250.231751:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873771648 00000100:00100000:1.0:1784045250.231792:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873771648 00000100:00100000:1.0:1784045250.232331:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784045250.232345:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873771648:12345-0@lo:101: 00010000:00010000:1.0:1784045250.232367:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045250.232394:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106e200/0x5475624df454c509 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c502 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045250.232430:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106e200/0x5475624df454c509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c502 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045250.232501:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106e200/0x5475624df454c509 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c502 expref: 19 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045250.232515:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106e200, rc 0) 00000100:00100000:1.0:1784045250.232637:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873771648:12345-0@lo:101: Request processed in 295us (5466us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.232645:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784045250.232751:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873771648:0@lo:101: 00010000:00010000:3.0:1784045250.232777:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.232789:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045250.232875:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873771776:0@lo:256: 00000100:00100000:3.0:1784045250.232923:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.234706:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92c48480 going to sleep for 11 seconds 00000100:00100000:0.0:1784045250.234716:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873771776 00000100:00100000:0.0:1784045250.234729:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873771776 00000100:00100000:0.0:1784045250.234787:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784045250.234866:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873771776:12345-0@lo:256: 20000000:01000000:0.0:1784045250.234898:0:6489:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784045250.234928:0:6489:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784045250.234931:0:6489:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1784045250.235266:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873771776:12345-0@lo:256: Request processed in 469us (2341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.235275:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784045250.235336:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873771776:0@lo:256: 10000000:01000000:3.0:1784045250.235422:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784045250.235433:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.235554:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045250.235566:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784045250.235569:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1784045250.235573:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784045250.235611:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.235620:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.235630:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045250.235650:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873771904:0@lo:101: 00000100:00100000:3.0:1784045250.235693:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.235726:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92c48480 going to sleep for 11 seconds 00000100:00100000:0.0:1784045250.235739:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873771904 00000100:00100000:0.0:1784045250.235745:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873771904 00000100:00100000:0.0:1784045250.235768:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784045250.235774:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873771904:12345-0@lo:101: 00010000:00010000:0.0:1784045250.235784:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045250.235865:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915aa800/0x5475624df454c517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c510 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045250.235900:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915aa800/0x5475624df454c517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c510 expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045250.235911:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915aa800/0x5475624df454c517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c510 expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045250.235921:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aa800, rc 0) 00000100:00100000:0.0:1784045250.235961:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873771904:12345-0@lo:101: Request processed in 186us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.235967:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784045250.236086:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873771904:0@lo:101: 00010000:00010000:3.0:1784045250.236101:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c517 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.236111:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c517 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045250.236187:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873772032:0@lo:501: 00000100:00100000:3.0:1784045250.236214:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.236274:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92c48480 going to sleep for 11 seconds 00000100:00100000:0.0:1784045250.236306:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873772032 00000100:00100000:0.0:1784045250.236310:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873772032 00000100:00100000:0.0:1784045250.236335:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784045250.236341:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873772032:12345-0@lo:501: 00000100:00100000:0.0:1784045250.237172:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873772032:12345-0@lo:501: Request processed in 827us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.237181:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784045250.237221:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873772032:0@lo:501: 00000100:00100000:0.0:1784045250.237257:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873772160:0@lo:503: 00000100:00100000:0.0:1784045250.237316:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045250.237351:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873772160 00000100:00100000:0.0:1784045250.237356:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873772160 00000100:00100000:0.0:1784045250.237385:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784045250.237402:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873772160:12345-0@lo:503: 00000100:00100000:0.0:1784045250.237587:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873772160:12345-0@lo:503: Request processed in 195us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.237602:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784045250.237639:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6f000 going to sleep for 11 seconds 00000100:00100000:0.0:1784045250.237649:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873772160:0@lo:503: 00000100:00100000:1.0:1784045250.242421:0:9928:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9928:1870706873772288:0@lo:502: 00000100:00100000:1.0:1784045250.242788:0:9928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045250.242959:0:9928:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd816c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045250.243405:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873772288 00000100:00100000:3.0:1784045250.243415:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873772288 00000100:00100000:3.0:1784045250.243783:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784045250.243795:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:9928:x1870706873772288:12345-0@lo:502: 00000100:00100000:3.0:1784045250.243993:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:9928:x1870706873772288:12345-0@lo:502: Request processed in 199us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045250.244002:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784045250.244281:0:9928:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9928:1870706873772288:0@lo:502: 00000020:01000000:1.0:1784045250.244329:0:9928:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784045250.244339:0:9928:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1784045250.244347:0:9928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045250.244349:0:9928:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784045250.244354:0:9928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784045250.244359:0:9928:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:1.0:1784045250.244384:0:9928:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1784045250.244386:0:9928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784045250.244419:0:9928:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff939cc13a3380) 00000020:00000080:1.0:1784045250.244474:0:9928:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1784045250.244480:0:9928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784045250.244604:0:9928:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1784045250.244612:0:9928:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784045250.244620:0:9928:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5475624df454c525 00010000:00080000:1.0:1784045250.244652:0:9928:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939cb6872000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1784045250.244915:0:9928:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1784045250.245373:0:9928:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1784045250.245387:0:9928:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1784045250.245634:0:9928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045250.245752:0:9928:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045250.246331:0:9928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1784045250.246473:0:9928:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1784045250.252753:0:9929:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045250.252766:0:9929:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784045250.253980:0:9928:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784045250.253999:0:9928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784045250.254063:0:9928:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784045250.254094:0:9928:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454c52c 00000100:00080000:0.0:1784045250.254107:0:9928:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784045250.254114:0:9928:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939cb6872000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045250.254164:0:9928:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82881f80 x1870706873772416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784045250.254193:0:9928:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784045250.254262:0:9928:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045250.254267:0:9928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045250.254269:0:9928:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784045250.254272:0:9928:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045250.254276:0:9928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045250.254277:0:9928:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784045250.254279:0:9928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784045250.254281:0:9928:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784045250.254312:0:9928:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9928:1870706873772544:0@lo:502: 00000100:00100000:0.0:1784045250.254416:0:9928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045250.254494:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873772544 00000100:00100000:0.0:1784045250.254502:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873772544 00000100:00100000:0.0:1784045250.254554:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784045250.254564:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:9928:x1870706873772544:12345-0@lo:502: 00000100:00100000:0.0:1784045250.254688:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:9928:x1870706873772544:12345-0@lo:502: Request processed in 125us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.254702:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784045250.254756:0:9928:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045250.254780:0:9928:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9928:1870706873772544:0@lo:502: 00000020:01000000:0.0:1784045250.254807:0:9928:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045250.254811:0:9928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045250.254813:0:9928:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784045250.254816:0:9928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:2.0:1784045250.254978:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873772416:0@lo:8: 00000100:00100000:2.0:1784045250.255023:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.255064:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873772416 00000100:00100000:2.0:1784045250.255067:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873772416 00000100:00100000:2.0:1784045250.255091:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784045250.255096:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1870706873772416:12345-0@lo:8: 00010000:00080000:2.0:1784045250.255123:0:8413:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1784045250.255157:0:8413:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454c533 00002000:00100000:2.0:1784045250.255174:0:8413:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff939b82051800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1784045250.255180:0:8413:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1784045250.255184:0:8413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1784045250.255262:0:8413:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784045250.255544:0:8413:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1784045250.255575:0:8413:0:(import.c:65:import_set_state_nolock()) ffff939b82056000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045250.255634:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3622:x1870706873772416:12345-0@lo:8: Request processed in 536us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045250.255642:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1784045250.255688:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82881f80 x1870706873772416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784045260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045250.255700:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784045250.255709:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1784045250.255717:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784045250.255729:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784045250.255732:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb6872000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784045250.255742:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784045250.255748:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873772416:0@lo:8: 00000004:00080000:1.0:1784045250.256000:0:9929:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784045250.256065:0:9929:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 206364620460ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784045250.256073:0:9929:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1784045250.256143:0:9930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9930:1870706873772672:0@lo:700: 00000100:00100000:1.0:1784045250.256188:0:9930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045250.256211:0:9930:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81600 going to sleep for 11 seconds 00000100:00100000:3.0:1784045250.256361:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873772672 00000100:00100000:3.0:1784045250.256368:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873772672 00000100:00100000:3.0:1784045250.256424:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784045250.256434:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9930:x1870706873772672:12345-0@lo:700: 00000100:00100000:3.0:1784045250.256500:0:8421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1375180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8421:1870706873772800:0@lo:700: 00000100:00100000:3.0:1784045250.256540:0:8421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.256560:0:8421:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92c489c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045250.256579:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873772800 00000100:00100000:3.0:1784045250.256584:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873772800 00000100:00100000:3.0:1784045250.256613:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784045250.256620:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8421:x1870706873772800:12345-0@lo:700: 00000100:00100000:3.0:1784045250.256820:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873772928:0@lo:400: 00000100:00100000:3.0:1784045250.257550:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.257594:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873773440:0@lo:400: 00000100:00100000:3.0:1784045250.257618:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.257652:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784045250.257658:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873773312:0@lo:400: 00000100:00100000:3.0:1784045250.257698:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.257722:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873773824:0@lo:400: 00000100:00100000:3.0:1784045250.257751:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045250.257782:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873773056:0@lo:400: 00000100:00100000:3.0:1784045250.257813:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784045250.257904:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045250.257911:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045250.258840:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873772928 00000100:00100000:1.0:1784045250.258851:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873772928 00000100:00100000:1.0:1784045250.258895:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873773440 00000100:00100000:1.0:1784045250.258899:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873773440 00000100:00100000:1.0:1784045250.258935:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873773312 00000100:00100000:1.0:1784045250.258938:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873773312 00000100:00100000:1.0:1784045250.258951:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873773824 00000100:00100000:1.0:1784045250.258954:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873773824 00000100:00100000:1.0:1784045250.258982:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873773056 00000100:00100000:1.0:1784045250.258986:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873773056 00000100:00100000:1.0:1784045250.259002:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784045250.259011:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873772928:12345-0@lo:400: 00000100:00100000:1.0:1784045250.259097:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873772928:12345-0@lo:400: Request processed in 87us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.259105:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784045250.259129:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784045250.259136:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873773440:12345-0@lo:400: 00000100:00100000:1.0:1784045250.259167:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873773440:12345-0@lo:400: Request processed in 31us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.259172:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784045250.259184:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784045250.259190:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873773312:12345-0@lo:400: 00000100:00100000:1.0:1784045250.259215:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873773312:12345-0@lo:400: Request processed in 26us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.259221:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784045250.259233:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784045250.259239:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873773824:12345-0@lo:400: 00000100:00100000:1.0:1784045250.259265:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873773824:12345-0@lo:400: Request processed in 27us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.259272:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784045250.259285:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784045250.259290:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873773056:12345-0@lo:400: 00000100:00100000:1.0:1784045250.259317:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873773056:12345-0@lo:400: Request processed in 28us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.259343:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784045250.259375:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873773184:0@lo:400: 00000100:00100000:1.0:1784045250.259413:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045250.259438:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873773696:0@lo:400: 00000100:00100000:1.0:1784045250.259492:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784045250.259524:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045250.259528:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045250.259750:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873773696 00000100:00100000:0.0:1784045250.259755:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873773696 00000100:00100000:0.0:1784045250.259800:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784045250.259808:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873773696:12345-0@lo:400: 00000020:01000000:2.0:1784045250.259901:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1784045250.259945:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784045250.259959:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c517 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.259973:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c517 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045250.259986:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784045250.259989:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939c9775c000 from 39 10000000:01000000:2.0:1784045250.259993:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784045250.260033:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.260043:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.260054:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045250.260074:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873773952:0@lo:101: 00000100:00100000:2.0:1784045250.260117:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.260153:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045250.260240:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873773568:0@lo:400: 00000100:00100000:3.0:1784045250.260275:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1784045250.260331:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc1374700 x1870706873773056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045250.260346:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873773056:0@lo:400: 00000100:00100000:3.0:1784045250.260385:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873773184 00000100:00100000:3.0:1784045250.260389:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873773184 00000100:00100000:3.0:1784045250.260418:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784045250.260424:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873773184:12345-0@lo:400: 00000100:00100000:3.0:1784045250.260484:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873773184:12345-0@lo:400: Request processed in 59us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045250.260491:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784045250.260538:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873773184:0@lo:400: 00010000:00080000:3.0:1784045250.260565:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc1377480 x1870706873773312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045250.260576:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873773312:0@lo:400: 00010000:00080000:3.0:1784045250.260589:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc1376a00 x1870706873773824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045250.260615:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873773824:0@lo:400: 00010000:00080000:3.0:1784045250.260629:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc1374a80 x1870706873772928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045250.260637:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873772928:0@lo:400: 00010000:00080000:3.0:1784045250.260649:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc1375500 x1870706873773440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045250.260656:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873773440:0@lo:400: 00000100:00100000:3.0:1784045250.260682:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873773952 00000100:00100000:3.0:1784045250.260686:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873773952 00000100:00100000:3.0:1784045250.260714:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784045250.260720:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873773952:12345-0@lo:101: 00010000:00010000:3.0:1784045250.260730:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045250.260747:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc2171400/0x5475624df454c541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c53a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.260773:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc2171400/0x5475624df454c541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c53a expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.260786:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc2171400/0x5475624df454c541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c53a expref: 21 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045250.260795:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171400, rc 0) 00000100:00100000:0.0:1784045250.261039:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873773696:12345-0@lo:400: Request processed in 1231us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.261048:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784045250.261064:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873773568 00000100:00100000:0.0:1784045250.261067:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873773568 00000100:00100000:0.0:1784045250.261093:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784045250.261099:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873773568:12345-0@lo:400: 00000100:00100000:0.0:1784045250.261133:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873773568:12345-0@lo:400: Request processed in 34us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.261140:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1784045250.261167:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784045250.261190:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc1376d80 x1870706873773696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045250.261201:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873773696:0@lo:400: 00010000:00080000:0.0:1784045250.261432:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc1377800 x1870706873773568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045250.261469:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873773568:0@lo:400: 00000100:00100000:2.0:1784045250.261702:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873773952:0@lo:101: 00010000:00010000:2.0:1784045250.261725:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c541 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.261745:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c541 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045250.261821:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873774080:0@lo:501: 00000100:00100000:2.0:1784045250.262107:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.262149:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045250.262237:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873773952:12345-0@lo:101: Request processed in 1515us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045250.262245:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784045250.262289:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873774080 00000100:00100000:3.0:1784045250.262294:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873774080 00000100:00100000:3.0:1784045250.262331:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784045250.262339:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873774080:12345-0@lo:501: 00000100:00100000:3.0:1784045250.262508:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873774080:12345-0@lo:501: Request processed in 170us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045250.262515:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784045250.263098:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873774080:0@lo:501: 00000100:00100000:2.0:1784045250.263143:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873774208:0@lo:503: 00000100:00100000:2.0:1784045250.263204:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.263240:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784045250.263368:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873774208 00000100:00100000:1.0:1784045250.263375:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873774208 00000100:00100000:1.0:1784045250.263412:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1784045250.263420:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873774208:12345-0@lo:503: 00000100:00100000:1.0:1784045250.263578:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873774208:12345-0@lo:503: Request processed in 158us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.263585:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784045250.263782:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873774208:0@lo:503: 00000004:00080000:2.0:1784045250.264294:0:7428:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1784045250.265177:0:9931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9931:1870706873774336:0@lo:502: 00000100:00100000:1.0:1784045250.265253:0:9931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045250.265298:0:9931:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045250.265419:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873774336 00000100:00100000:0.0:1784045250.265428:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873774336 00000100:00100000:0.0:1784045250.265496:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784045250.265506:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:9931:x1870706873774336:12345-0@lo:502: 00000100:00100000:0.0:1784045250.265651:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:9931:x1870706873774336:12345-0@lo:502: Request processed in 147us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.265659:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784045250.266066:0:9931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9931:1870706873774336:0@lo:502: 00000100:00100000:2.0:1784045250.266127:0:9931:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9931:1870706873774464:0@lo:502: 00000100:00100000:2.0:1784045250.266170:0:9931:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.266203:0:9931:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045250.266544:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873774464 00000100:00100000:0.0:1784045250.266550:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873774464 00000100:00100000:0.0:1784045250.266590:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784045250.266599:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:9931:x1870706873774464:12345-0@lo:502: 00000100:00100000:0.0:1784045250.266739:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:9931:x1870706873774464:12345-0@lo:502: Request processed in 140us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.266746:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 40000000:02000000:3.0:1784045250.267213:0:6503:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1784045250.270596:0:9931:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9931:1870706873774464:0@lo:502: 00000040:00080000:0.0:1784045250.275022:0:9931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00100000:3.0:1784045250.275604:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8421:x1870706873772800:12345-0@lo:700: Request processed in 18976us (19055us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045250.275621:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1784045250.275664:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 00010000:00080000:3.0:1784045250.275686:0:8421:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc1375180 x1870706873772800/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784045266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784045250.275695:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:3.0:1784045250.275704:0:8421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1375180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8421:1870706873772800:0@lo:700: 00010000:00010000:2.0:1784045250.275709:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c541 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 40000000:02000000:3.0:1784045250.275721:0:8421:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00010000:00010000:2.0:1784045250.275721:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c541 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045250.275733:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784045250.275759:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939c9775c000 from 6 10000000:01000000:2.0:1784045250.275763:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784045250.275813:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.275822:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.275843:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045250.275868:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873774592:0@lo:101: 00000100:00100000:2.0:1784045250.275999:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.276049:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873774592 00000100:00100000:2.0:1784045250.276058:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873774592 00000100:00100000:2.0:1784045250.276109:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784045250.276120:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873774592:12345-0@lo:101: 00010000:00010000:2.0:1784045250.276135:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045250.276151:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81987600/0x5475624df454c54f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c548 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.276180:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987600/0x5475624df454c54f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c548 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.276193:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81987600/0x5475624df454c54f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c548 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.276204:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987600, rc 0) 00000100:00100000:2.0:1784045250.276230:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873774592:12345-0@lo:101: Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045250.276247:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784045250.276295:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045250.276309:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873774592:0@lo:101: 00010000:00010000:2.0:1784045250.276336:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.276347:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045250.276398:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873774720:0@lo:256: 00000100:00100000:2.0:1784045250.276430:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.276480:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873774720 00000100:00100000:2.0:1784045250.276484:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873774720 00000100:00100000:2.0:1784045250.276510:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784045250.276517:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873774720:12345-0@lo:256: 20000000:01000000:2.0:1784045250.276532:0:6490:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784045250.276551:0:6490:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784045250.276554:0:6490:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1784045250.276737:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873774720:12345-0@lo:256: Request processed in 220us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045250.276744:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784045250.276870:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045250.276886:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873774720:0@lo:256: 10000000:01000000:2.0:1784045250.277009:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784045250.277017:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.277035:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045250.277042:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784045250.277044:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1784045250.277047:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784045250.277068:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.277075:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.277082:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045250.277094:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873774848:0@lo:101: 00000100:00100000:2.0:1784045250.277121:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.277143:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873774848 00000100:00100000:2.0:1784045250.277146:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873774848 00000100:00100000:2.0:1784045250.277170:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784045250.277176:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873774848:12345-0@lo:101: 00010000:00010000:2.0:1784045250.277185:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045250.277195:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81987200/0x5475624df454c55d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c556 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.277211:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987200/0x5475624df454c55d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c556 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.277220:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81987200/0x5475624df454c55d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c556 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.277233:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987200, rc 0) 00000100:00100000:2.0:1784045250.277257:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873774848:12345-0@lo:101: Request processed in 81us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045250.277263:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784045250.277288:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045250.277299:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873774848:0@lo:101: 00010000:00010000:2.0:1784045250.277311:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c55d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.278156:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c55d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045250.281219:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873774976:0@lo:501: 00000100:00100000:2.0:1784045250.281310:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.281383:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a49840 going to sleep for 11 seconds 00000100:00100000:1.0:1784045250.281612:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873774976 00000100:00100000:1.0:1784045250.281623:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873774976 00000100:00100000:1.0:1784045250.281677:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1784045250.281688:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873774976:12345-0@lo:501: 00000100:00100000:1.0:1784045250.282034:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873774976:12345-0@lo:501: Request processed in 347us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.282044:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1784045250.282162:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873774976:0@lo:501: 00000100:00100000:0.0:1784045250.282210:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873775104:0@lo:503: 00000100:00100000:0.0:1784045250.282259:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045250.282285:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6f840 going to sleep for 11 seconds 00000100:00100000:2.0:1784045250.282353:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873775104 00000100:00100000:2.0:1784045250.282358:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873775104 00000100:00100000:2.0:1784045250.282426:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784045250.282434:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873775104:12345-0@lo:503: 00000100:00100000:2.0:1784045250.282581:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873775104:12345-0@lo:503: Request processed in 148us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045250.282589:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1784045250.282728:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873775104:0@lo:503: 00000001:00100000:1.0:1784045250.288051:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1784045250.289428:0:9932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9932:1870706873775232:0@lo:502: 00000100:00100000:2.0:1784045250.289557:0:9932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.289617:0:9932:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c901c8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045250.289864:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873775232 00000100:00100000:0.0:1784045250.289872:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873775232 00000100:00100000:0.0:1784045250.289932:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784045250.289944:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:9932:x1870706873775232:12345-0@lo:502: 00000100:00100000:0.0:1784045250.290111:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:9932:x1870706873775232:12345-0@lo:502: Request processed in 169us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.290120:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784045250.290245:0:9932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9932:1870706873775232:0@lo:502: 00000020:01000000:2.0:1784045250.290291:0:9932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784045250.290299:0:9932:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784045250.290310:0:9932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045250.290312:0:9932:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784045250.290328:0:9932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784045250.290333:0:9932:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:2.0:1784045250.290359:0:9932:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784045250.290362:0:9932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045250.290381:0:9932:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff939c9fddb380) 00000020:00000080:2.0:1784045250.290413:0:9932:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1784045250.290419:0:9932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784045250.290562:0:9932:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784045250.290569:0:9932:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1784045250.290587:0:9932:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454c56b 00010000:00080000:2.0:1784045250.290623:0:9932:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939cbf47b800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:2.0:1784045250.291128:0:9932:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1784045250.291293:0:9932:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1784045250.291307:0:9932:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784045250.291679:0:9932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784045250.292065:0:9932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784045250.292228:0:9932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1784045250.292698:0:9932:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:2.0:1784045250.296493:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9930:x1870706873772672:12345-0@lo:700: Request processed in 40046us (40288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045250.296512:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784045250.299269:0:9930:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb684b800 x1870706873772672/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784045266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045250.299295:0:9930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9930:1870706873772672:0@lo:700: 00000040:00080000:1.0:1784045250.303234:0:9933:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045250.303243:0:9933:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784045250.304660:0:9932:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784045250.304675:0:9932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784045250.304725:0:9932:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784045250.304757:0:9932:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454c572 00000100:00080000:0.0:1784045250.304771:0:9932:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784045250.304778:0:9932:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939cbf47b800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045250.304825:0:9932:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82881180 x1870706873775360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784045250.304855:0:9932:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784045250.304912:0:9932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045250.304916:0:9932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045250.304918:0:9932:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784045250.304922:0:9932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045250.304937:0:9932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045250.304938:0:9932:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784045250.304942:0:9932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784045250.304944:0:9932:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784045250.304980:0:9932:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9932:1870706873775488:0@lo:502: 00000100:00100000:0.0:1784045250.305085:0:9932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045250.305135:0:9932:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045250.305386:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873775360:0@lo:8: 00000100:00100000:3.0:1784045250.305434:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045250.305715:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873775360 00000100:00100000:0.0:1784045250.305726:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873775360 00000100:00100000:0.0:1784045250.305815:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784045250.305829:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1870706873775360:12345-0@lo:8: 00010000:00080000:0.0:1784045250.305863:0:8411:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:0.0:1784045250.305902:0:8411:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454c579 00002000:00100000:0.0:1784045250.305932:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff939cbf4b8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784045250.305937:0:8411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784045250.305940:0:8411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784045250.306043:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784045250.306071:0:8411:0:(import.c:65:import_set_state_nolock()) ffff939cbf4bd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045250.307234:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1870706873775360:12345-0@lo:8: Request processed in 1402us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.307246:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1784045250.307388:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82881180 x1870706873775360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784045260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045250.307402:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784045250.307413:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784045250.307424:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784045250.307431:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1784045250.307435:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cbf47b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784045250.307480:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784045250.307488:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873775360:0@lo:8: 00000004:00080000:1.0:1784045250.308200:0:9933:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1784045250.308263:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873775488 00000100:00100000:2.0:1784045250.308273:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873775488 00000100:00100000:2.0:1784045250.308342:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784045250.308459:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:9932:x1870706873775488:12345-0@lo:502: 00000100:00100000:2.0:1784045250.308768:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:9932:x1870706873775488:12345-0@lo:502: Request processed in 417us (3682us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045250.308784:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784045250.308992:0:9932:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:9932:1870706873775488:0@lo:502: 00000020:01000000:2.0:1784045250.309029:0:9932:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045250.309038:0:9932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045250.309040:0:9932:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784045250.309045:0:9932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1784045250.309131:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1784045250.309167:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784045250.309179:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c55d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045250.309206:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c55d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045250.309241:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784045250.309245:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff939c901d3380 from 1 10000000:01000000:0.0:1784045250.309248:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784045250.309285:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045250.309294:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045250.309302:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045250.309336:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873775616:0@lo:101: 00000100:00100000:0.0:1784045250.309386:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045250.309430:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6f300 going to sleep for 11 seconds 00000100:00100000:2.0:1784045250.310986:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873775616 00000100:00100000:2.0:1784045250.311001:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873775616 00000100:00100000:2.0:1784045250.311060:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784045250.311070:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873775616:12345-0@lo:101: 00010000:00010000:2.0:1784045250.311088:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045250.311111:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81987c00/0x5475624df454c587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c580 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.311158:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987c00/0x5475624df454c587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c580 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.311171:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81987c00/0x5475624df454c587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c580 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.311181:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987c00, rc 0) 00000100:00100000:2.0:1784045250.311253:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873775616:12345-0@lo:101: Request processed in 184us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045250.311260:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1784045250.311308:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873775616:0@lo:101: 00010000:00010000:0.0:1784045250.311339:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c587 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045250.311365:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c587 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045250.311503:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873775744:0@lo:501: 00000100:00100000:0.0:1784045250.311539:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045250.311577:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6f300 going to sleep for 11 seconds 00000100:00100000:2.0:1784045250.311649:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873775744 00000100:00100000:2.0:1784045250.311654:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873775744 00000100:00100000:2.0:1784045250.311687:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784045250.311694:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873775744:12345-0@lo:501: 00000100:00100000:2.0:1784045250.311786:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873775744:12345-0@lo:501: Request processed in 91us (246us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045250.311793:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784045250.311819:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873775744:0@lo:501: 10000000:01000000:2.0:1784045250.311866:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784045250.311875:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c587 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045250.311883:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c587 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784045250.312070:0:9933:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 206420624023ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784045250.312079:0:9933:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1784045250.312774:0:9930:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1784045250.312800:0:9930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9930:1870706873776000:0@lo:7: 00000100:00100000:2.0:1784045250.312964:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873775872:0@lo:13: 00000100:00100000:2.0:1784045250.313017:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045250.313060:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873776128:0@lo:13: 00000100:00100000:2.0:1784045250.313068:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873775872 00000100:00100000:2.0:1784045250.313073:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873775872 00000100:00100000:0.0:1784045250.313094:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1784045250.313133:0:9934:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1784045250.313146:0:9930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045250.313151:0:9934:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9934:1870706873776256:0@lo:7: 00000100:00100000:1.0:1784045250.313166:0:9930:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81600 going to sleep for 11 seconds 00000100:00100000:0.0:1784045250.313173:0:9934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045250.313188:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873776000 00000100:00100000:0.0:1784045250.313188:0:9934:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784045250.313192:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873776000 00000100:00100000:1.0:1784045250.313231:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873776256 00000100:00100000:1.0:1784045250.313235:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873776256 00000100:00100000:1.0:1784045250.313273:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784045250.313280:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9930:x1870706873776000:12345-0@lo:7: 00000100:00100000:0.0:1784045250.313341:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784045250.313349:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9934:x1870706873776256:12345-0@lo:7: 00000100:00080000:0.0:1784045250.319067:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784045250.319387:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873776128 00000100:00100000:2.0:1784045250.319402:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873776128 00000100:00100000:2.0:1784045250.319470:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784045250.319481:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1870706873775872:12345-0@lo:13: 00002000:00000024:2.0:1784045250.319522:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923865600 avail 3692343296 00000100:00100000:2.0:1784045250.319638:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1870706873775872:12345-0@lo:13: Request processed in 159us (6621us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045250.319646:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1784045250.319699:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b81999180 x1870706873775872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045250.319724:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873775872:0@lo:13: 00000100:00100000:2.0:1784045250.319777:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784045250.319785:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1870706873776128:12345-0@lo:13: 00002000:00000024:2.0:1784045250.319797:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923865600 avail 3692343296 00000100:00100000:2.0:1784045250.321081:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1870706873776128:12345-0@lo:13: Request processed in 1290us (7979us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045250.321092:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1784045250.321967:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82883800 x1870706873776128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045250.321996:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873776128:0@lo:13: 00002000:00080000:1.0:1784045250.324689:0:8412:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1784045250.324701:0:8412:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00010000:00080000:2.0:1784045250.325290:0:9930:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b8199bb80 x1870706873776000/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784045266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045250.325310:0:9930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9930:1870706873776000:0@lo:7: 00000004:00080000:2.0:1784045250.325339:0:9930:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784045250.325389:0:9930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9930:1870706873776384:0@lo:5: 00000100:00100000:2.0:1784045250.325435:0:9930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.325487:0:9930:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c87df7180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045250.325514:0:8413:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1784045250.325521:0:8413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1784045250.325765:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9930:x1870706873776000:12345-0@lo:7: Request processed in 12483us (12615us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.325777:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784045250.325813:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873776384 00000100:00100000:1.0:1784045250.325820:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873776384 00000100:00100000:1.0:1784045250.326278:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784045250.326287:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9930:x1870706873776384:12345-0@lo:5: 00002000:00080000:1.0:1784045250.326339:0:8412:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1784045250.326395:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9930:x1870706873776384:12345-0@lo:5: Request processed in 108us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045250.326401:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1784045250.326504:0:9930:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8d500 x1870706873776384/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045250.326516:0:9930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9930:1870706873776384:0@lo:5: 00000004:00080000:2.0:1784045250.326530:0:9930:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1784045250.326565:0:9930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9930:1870706873776512:0@lo:5: 00000100:00100000:2.0:1784045250.326598:0:9930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.326631:0:9930:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c87df7180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045250.326647:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873776512 00000100:00100000:2.0:1784045250.326652:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873776512 00000100:00100000:2.0:1784045250.326672:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045250.326678:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9930:x1870706873776512:12345-0@lo:5: 00002000:00080000:2.0:1784045250.326705:0:8411:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00002000:00080000:0.0:1784045250.327249:0:8648:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1784045250.327254:0:8648:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000004:00080000:3.0:1784045250.327906:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1784045250.331314:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9934:x1870706873776256:12345-0@lo:7: Request processed in 17953us (18126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.331340:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1784045250.331400:0:9934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82880e00 x1870706873776256/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784045266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045250.331420:0:9934:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9934:1870706873776256:0@lo:7: 00000004:00080000:1.0:1784045250.331437:0:9934:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1784045250.331506:0:9934:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9934:1870706873776640:0@lo:5: 00000100:00100000:1.0:1784045250.331578:0:9934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045250.331615:0:9934:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92ca1300 going to sleep for 11 seconds 00000100:00100000:0.0:1784045250.331818:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873776640 00000100:00100000:0.0:1784045250.331918:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873776640 00000100:00100000:0.0:1784045250.332045:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045250.332055:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9934:x1870706873776640:12345-0@lo:5: 00002000:00080000:0.0:1784045250.332091:0:8412:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1784045250.332095:0:8412:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1784045250.334966:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9930:x1870706873776512:12345-0@lo:5: Request processed in 8276us (8356us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784045250.334980:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1784045250.335103:0:9930:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8d500 x1870706873776512/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045250.335125:0:9930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9930:1870706873776512:0@lo:5: 00000004:00080000:2.0:1784045250.335543:0:9930:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1784045250.336108:0:9930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9930:1870706873776768:0@lo:900: 00000100:00100000:2.0:1784045250.336187:0:9930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045250.336233:0:9930:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c87df7180 going to sleep for 11 seconds 00000100:00100000:0.0:1784045250.336391:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873776768 00000100:00100000:0.0:1784045250.336401:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873776768 00000100:00100000:0.0:1784045250.336498:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045250.336508:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9930:x1870706873776768:12345-0@lo:900: 00000100:00100000:0.0:1784045250.336587:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9930:x1870706873776768:12345-0@lo:900: Request processed in 79us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.336594:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784045250.336719:0:9930:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8dc00 x1870706873776768/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784045266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045250.336733:0:9930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9930:1870706873776768:0@lo:900: 00000001:00080000:3.0:1784045250.354421:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1784045250.354479:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1784045250.354497:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784045250.354714:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9934:x1870706873776640:12345-0@lo:5: Request processed in 22652us (23127us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784045250.354731:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1784045250.354852:0:9934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c91561880 x1870706873776640/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045266 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045250.354868:0:9934:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1784045250.354876:0:9934:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9934:1870706873776640:0@lo:5: 00000004:00080000:1.0:1784045250.354895:0:9934:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1784045250.354960:0:9934:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9934:1870706873776896:0@lo:700: 00000100:00100000:1.0:1784045250.355034:0:9934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045250.355097:0:9934:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92ca1300 going to sleep for 11 seconds 00000100:00100000:3.0:1784045250.355136:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873776896 00000100:00100000:3.0:1784045250.355146:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873776896 00000100:00100000:3.0:1784045250.355224:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784045250.355234:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9934:x1870706873776896:12345-0@lo:700: 00000100:00100000:0.0:1784045250.377079:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9934:x1870706873776896:12345-0@lo:700: Request processed in 21833us (22031us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045250.377098:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784045250.377224:0:9934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c91561880 x1870706873776896/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784045266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045250.377268:0:9934:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9934:1870706873776896:0@lo:700: 00000004:02000040:1.0:1784045250.383497:0:9934:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1784045250.392491:0:9934:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9934:1870706873777024:0@lo:5: 00000100:00100000:0.0:1784045250.392684:0:9934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045250.392767:0:9934:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6f480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045250.392840:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873777024 00000100:00100000:1.0:1784045250.392851:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873777024 00000100:00100000:1.0:1784045250.392914:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784045250.392924:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9934:x1870706873777024:12345-0@lo:5: 00002000:00080000:0.0:1784045250.401801:0:8648:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1784045250.401830:0:8648:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1784045250.428391:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9934:x1870706873777024:12345-0@lo:5: Request processed in 35458us (35697us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784045250.428419:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1784045250.428715:0:9934:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82881f80 x1870706873777024/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045266 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045250.428737:0:9934:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9934:1870706873777024:0@lo:5: 00000004:00080000:1.0:1784045250.428755:0:9934:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:1.0:1784045250.516176:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784045250.947836:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1784045251.540594:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045252.563988:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784045253.087379:0:10017:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784045253.087967:0:10017:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784045253.267681:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045253.267723:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873777152:0@lo:13: 00000100:00100000:2.0:1784045253.267824:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045253.268071:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873777152 00000100:00100000:0.0:1784045253.268082:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873777152 00000100:00100000:0.0:1784045253.268164:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045253.268177:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873777152:12345-0@lo:13: 00002000:00000024:0.0:1784045253.268215:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045253.268282:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873777152:12345-0@lo:13: Request processed in 109us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045253.268291:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1784045253.268354:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8c700 x1870706873777152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045253.268377:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873777152:0@lo:13: 00000100:00080000:2.0:1784045253.268433:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045253.269876:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873777280:0@lo:13: 00000100:00100000:2.0:1784045253.269957:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045253.270116:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873777280 00000100:00100000:3.0:1784045253.270126:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873777280 00000100:00100000:3.0:1784045253.270203:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784045253.270213:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873777280:12345-0@lo:13: 00002000:00000024:3.0:1784045253.270240:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045253.270310:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873777280:12345-0@lo:13: Request processed in 89us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045253.270318:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1784045253.270361:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf435880 x1870706873777280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045253.270381:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873777280:0@lo:13: 00000100:00080000:2.0:1784045253.270652:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784045253.588027:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045253.780024:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045253.780064:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873777408:0@lo:41: 00000100:00100000:3.0:1784045253.780164:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045253.780648:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873777408 00000100:00100000:0.0:1784045253.780659:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873777408 00000100:00100000:0.0:1784045253.780719:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784045253.780729:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873777408:12345-0@lo:41: 00000004:00000024:0.0:1784045253.780773:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045253.780843:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873777408:12345-0@lo:41: Request processed in 115us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045253.780850:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784045253.780938:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873777408:0@lo:41: 00000020:00000004:2.0:1784045254.369710:0:10065:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784045254.369723:0:10065:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1784045254.612585:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045254.968353:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045254.968814:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863243392 00000100:00100000:2.0:1784045254.968846:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863243392 00000100:00100000:2.0:1784045254.968911:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 178 00000100:00100000:2.0:1784045254.968923:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2393:x1870706863243392:12345-192.168.203.44@tcp:250: 00010000:00080000:2.0:1784045254.968962:0:6489:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 019b5529-a0fa-4aaf-b296-1845dacd5d85@192.168.203.44@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1784045254.968998:0:6489:0:(genops.c:1406:class_connect()) connect: client 019b5529-a0fa-4aaf-b296-1845dacd5d85, cookie 0x5475624df454c58e 00000100:00080000:2.0:1784045254.969158:0:6489:0:(import.c:65:import_set_state_nolock()) ffff939cbf47e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045254.969244:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+5:2393:x1870706863243392:12345-192.168.203.44@tcp:250: Request processed in 322us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045254.969253:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 178 00000100:00100000:1.0:1784045254.986700:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045254.986870:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863243520 00000100:00100000:0.0:1784045254.986884:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863243520 00000100:00100000:0.0:1784045254.986966:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 179 00000100:00100000:0.0:1784045254.986989:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+5:6152:x1870706863243520:12345-192.168.203.44@tcp:101: 00010000:00010000:0.0:1784045254.987011:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045254.987035:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915aba00/0x5475624df454c595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73ed49 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045254.987102:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915aba00/0x5475624df454c595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ed49 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045254.987115:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915aba00/0x5475624df454c595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ed49 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045254.987126:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aba00, rc 0) 00000100:00100000:0.0:1784045254.987206:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+6:6152:x1870706863243520:12345-192.168.203.44@tcp:101: Request processed in 231us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045254.987213:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 179 00000100:00100000:3.0:1784045254.996772:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045254.997537:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863243648 00000100:00100000:0.0:1784045254.997562:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863243648 00000100:00100000:0.0:1784045254.997643:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 180 00000100:00100000:0.0:1784045254.997655:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+6:6152:x1870706863243648:12345-192.168.203.44@tcp:501: 00000100:00100000:0.0:1784045254.997816:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+6:6152:x1870706863243648:12345-192.168.203.44@tcp:501: Request processed in 163us (1057us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784045254.997825:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 180 00000100:00100000:3.0:1784045255.000968:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045255.001127:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863243776 00000100:00100000:2.0:1784045255.001140:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863243776 00000100:00100000:2.0:1784045255.001212:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 181 00000100:00100000:2.0:1784045255.001225:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+6:6152:x1870706863243776:12345-192.168.203.44@tcp:101: 00010000:00010000:2.0:1784045255.001246:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045255.001271:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81986a00/0x5475624df454c59c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73ed50 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045255.001317:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986a00/0x5475624df454c59c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ed50 expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045255.001331:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81986a00/0x5475624df454c59c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ed50 expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045255.001342:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986a00, rc 0) 00000100:00100000:2.0:1784045255.001431:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+7:6152:x1870706863243776:12345-192.168.203.44@tcp:101: Request processed in 209us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045255.001437:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 181 00000100:00100000:1.0:1784045255.005099:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045255.005273:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863243904 00000100:00100000:2.0:1784045255.005310:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863243904 00000100:00100000:2.0:1784045255.005516:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 182 00000100:00100000:2.0:1784045255.005530:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+7:6152:x1870706863243904:12345-192.168.203.44@tcp:501: 00000100:00100000:2.0:1784045255.005963:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+8:6152:x1870706863243904:12345-192.168.203.44@tcp:501: Request processed in 434us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045255.005973:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 182 00000100:00100000:3.0:1784045255.021119:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045255.021320:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863244032 00000100:00100000:0.0:1784045255.021334:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863244032 00000100:00100000:0.0:1784045255.021416:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 183 00000100:00100000:0.0:1784045255.021430:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+8:6152:x1870706863244032:12345-192.168.203.44@tcp:503: 00000100:00100000:0.0:1784045255.021677:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+8:6152:x1870706863244032:12345-192.168.203.44@tcp:503: Request processed in 249us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.021685:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 183 00000100:00100000:3.0:1784045255.028209:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045255.029360:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863244160 00000100:00100000:2.0:1784045255.029377:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863244160 00000100:00100000:2.0:1784045255.029491:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 184 00000100:00100000:2.0:1784045255.029505:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+8:6170:x1870706863244160:12345-192.168.203.44@tcp:502: 00000100:00100000:2.0:1784045255.029744:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+8:6170:x1870706863244160:12345-192.168.203.44@tcp:502: Request processed in 242us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045255.029754:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 184 00000100:00100000:2.0:1784045255.065250:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045255.066597:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863244288 00000100:00100000:1.0:1784045255.066615:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863244288 00000100:00100000:1.0:1784045255.066696:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 185 00000100:00100000:1.0:1784045255.066708:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+8:6170:x1870706863244288:12345-192.168.203.44@tcp:502: 00000100:00100000:1.0:1784045255.066924:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+8:6170:x1870706863244288:12345-192.168.203.44@tcp:502: Request processed in 216us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045255.066933:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 185 00000100:00100000:3.0:1784045255.078883:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045255.079007:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863244416 00000100:00100000:0.0:1784045255.079036:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863244416 00000100:00100000:0.0:1784045255.079104:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 186 00000100:00100000:0.0:1784045255.079115:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+8:6152:x1870706863244416:12345-192.168.203.44@tcp:101: 00010000:00010000:0.0:1784045255.079136:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045255.079157:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915aac00/0x5475624df454c5a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73ed81 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045255.079195:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915aac00/0x5475624df454c5a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ed81 expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045255.079209:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915aac00/0x5475624df454c5a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ed81 expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045255.079220:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aac00, rc 0) 00000100:00100000:0.0:1784045255.079302:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6152:x1870706863244416:12345-192.168.203.44@tcp:101: Request processed in 188us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.079310:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 186 00000100:00100000:3.0:1784045255.085396:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045255.085558:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863244544 00000100:00100000:2.0:1784045255.085571:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863244544 00000100:00100000:2.0:1784045255.085643:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 187 00000100:00100000:2.0:1784045255.085656:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6152:x1870706863244544:12345-192.168.203.44@tcp:256: 20000000:01000000:2.0:1784045255.085691:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784045255.085721:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784045255.085726:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784045255.085729:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784045255.085732:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784045255.085734:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1784045255.095607:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6152:x1870706863244544:12345-192.168.203.44@tcp:256: Request processed in 9555us (9824us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.095624:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 187 00000100:00100000:3.0:1784045255.103550:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045255.103661:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863244672 00000100:00100000:1.0:1784045255.103671:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863244672 00000100:00100000:1.0:1784045255.103744:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 188 00000100:00100000:1.0:1784045255.103753:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6152:x1870706863244672:12345-192.168.203.44@tcp:101: 00010000:00010000:1.0:1784045255.103769:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045255.103789:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106e800/0x5475624df454c5aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73ed88 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045255.103817:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106e800/0x5475624df454c5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ed88 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045255.103829:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106e800/0x5475624df454c5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ed88 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045255.103839:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106e800, rc 0) 00000100:00100000:1.0:1784045255.103901:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6152:x1870706863244672:12345-192.168.203.44@tcp:101: Request processed in 149us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045255.103908:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 188 00000100:00100000:3.0:1784045255.107150:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045255.107257:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863244800 00000100:00100000:0.0:1784045255.107266:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863244800 00000100:00100000:0.0:1784045255.107330:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 189 00000100:00100000:0.0:1784045255.107340:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6152:x1870706863244800:12345-192.168.203.44@tcp:501: 00000100:00100000:0.0:1784045255.107531:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6152:x1870706863244800:12345-192.168.203.44@tcp:501: Request processed in 192us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.107540:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 189 00000100:00100000:2.0:1784045255.109430:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045255.109853:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863244928 00000100:00100000:0.0:1784045255.109873:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863244928 00000100:00100000:0.0:1784045255.109928:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 190 00000100:00100000:0.0:1784045255.109937:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6152:x1870706863244928:12345-192.168.203.44@tcp:503: 00000100:00100000:0.0:1784045255.110176:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6152:x1870706863244928:12345-192.168.203.44@tcp:503: Request processed in 238us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.110183:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 190 00000100:00100000:3.0:1784045255.114114:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045255.114395:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863245056 00000100:00100000:1.0:1784045255.114405:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863245056 00000100:00100000:1.0:1784045255.114495:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 191 00000100:00100000:1.0:1784045255.114505:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6175:x1870706863245056:12345-192.168.203.44@tcp:502: 00000100:00100000:1.0:1784045255.114675:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6175:x1870706863245056:12345-192.168.203.44@tcp:502: Request processed in 171us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045255.114683:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 191 00000100:00100000:3.0:1784045255.128388:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045255.128538:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863245184 00000100:00100000:0.0:1784045255.128548:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863245184 00000100:00100000:0.0:1784045255.128605:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 192 00000100:00100000:0.0:1784045255.128616:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6175:x1870706863245184:12345-192.168.203.44@tcp:502: 00000100:00100000:0.0:1784045255.128772:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6175:x1870706863245184:12345-192.168.203.44@tcp:502: Request processed in 157us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.128780:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 192 00000100:00100000:3.0:1784045255.138138:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045255.138182:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045255.138762:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863245312 00000100:00100000:0.0:1784045255.138774:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863245312 00000100:00100000:0.0:1784045255.138813:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863245568 00000100:00100000:0.0:1784045255.138816:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863245568 00000100:00100000:0.0:1784045255.138830:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:0.0:1784045255.138837:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1870706863245312:12345-192.168.203.44@tcp:38: 00010000:00080000:0.0:1784045255.138868:0:6498:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:0.0:1784045255.138916:0:6498:0:(genops.c:1406:class_connect()) connect: client bbcbf11d-b5f2-42a6-9759-7590eb85aa60, cookie 0x5475624df454c5b1 00000004:00100000:0.0:1784045255.138938:0:6498:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1784045255.139147:0:6498:0:(import.c:65:import_set_state_nolock()) ffff939cbf4bf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045255.139373:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2393:x1870706863245312:12345-192.168.203.44@tcp:38: Request processed in 533us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.139381:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:0.0:1784045255.139413:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:0.0:1784045255.139418:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1870706863245568:12345-192.168.203.44@tcp:38: 00010000:00080000:0.0:1784045255.139434:0:6498:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:0.0:1784045255.139514:0:6498:0:(genops.c:1406:class_connect()) connect: client bbcbf11d-b5f2-42a6-9759-7590eb85aa60, cookie 0x5475624df454c5b8 00000004:00100000:0.0:1784045255.139527:0:6498:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1784045255.139736:0:6498:0:(import.c:65:import_set_state_nolock()) ffff939cbf4b9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045255.139766:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2393:x1870706863245568:12345-192.168.203.44@tcp:38: Request processed in 346us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.139772:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:3.0:1784045255.315783:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045255.315811:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873777536:0@lo:41: 00000100:00100000:3.0:1784045255.315885:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045255.316059:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873777536 00000100:00100000:0.0:1784045255.316068:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873777536 00000100:00100000:0.0:1784045255.316130:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784045255.316139:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873777536:12345-0@lo:41: 00000004:00000024:0.0:1784045255.316175:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1784045255.316232:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873777536:12345-0@lo:41: Request processed in 94us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.316239:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784045255.316432:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873777536:0@lo:41: 00000100:00100000:1.0:1784045255.316879:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873777920:0@lo:400: 00000100:00100000:1.0:1784045255.316919:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045255.316940:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873778432:0@lo:400: 00000100:00100000:1.0:1784045255.316964:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045255.317003:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873778944:0@lo:400: 00000100:00100000:1.0:1784045255.317025:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045255.317047:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784045255.317052:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873777792:0@lo:400: 00000100:00100000:1.0:1784045255.317073:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045255.317086:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873778304:0@lo:400: 00000100:00100000:1.0:1784045255.317105:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045255.317119:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873778816:0@lo:400: 00000100:00100000:1.0:1784045255.317143:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045255.317165:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873778432 00000100:00100000:1.0:1784045255.317170:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873778432 00000100:00100000:1.0:1784045255.317205:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873778944 00000100:00100000:1.0:1784045255.317208:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873778944 00000100:00100000:1.0:1784045255.317224:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784045255.317231:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873778432:12345-0@lo:400: 00000100:00100000:1.0:1784045255.317274:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873778432:12345-0@lo:400: Request processed in 43us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045255.317281:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784045255.317409:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784045255.317419:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873778944:12345-0@lo:400: 00000100:00100000:0.0:1784045255.317471:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873778944:12345-0@lo:400: Request processed in 54us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.317477:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784045255.317528:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873777920 00000100:00100000:3.0:1784045255.317533:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873777920 00000100:00100000:3.0:1784045255.317566:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873777792 00000100:00100000:3.0:1784045255.317569:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873777792 00000100:00100000:3.0:1784045255.317582:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873778304 00000100:00100000:3.0:1784045255.317584:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873778304 00000100:00100000:3.0:1784045255.317596:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873778816 00000100:00100000:3.0:1784045255.317598:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873778816 00000100:00100000:3.0:1784045255.317612:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784045255.317618:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873777920:12345-0@lo:400: 00000100:00100000:3.0:1784045255.317653:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873777920:12345-0@lo:400: Request processed in 35us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.317659:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784045255.317672:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784045255.317678:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873777792:12345-0@lo:400: 00000100:00100000:3.0:1784045255.317717:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873777792:12345-0@lo:400: Request processed in 39us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.317723:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784045255.317735:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784045255.317740:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873778304:12345-0@lo:400: 00000100:00100000:3.0:1784045255.317767:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873778304:12345-0@lo:400: Request processed in 27us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.317773:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784045255.317784:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784045255.317790:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873778816:12345-0@lo:400: 00000100:00100000:3.0:1784045255.317814:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873778816:12345-0@lo:400: Request processed in 25us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.317819:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784045255.317838:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873777664:0@lo:400: 00000100:00100000:3.0:1784045255.317868:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045255.317893:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873778176:0@lo:400: 00000100:00100000:3.0:1784045255.317914:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045255.317930:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873778688:0@lo:400: 00000100:00100000:3.0:1784045255.317949:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045255.317963:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784045255.317969:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873778048:0@lo:400: 00000100:00100000:3.0:1784045255.317990:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045255.318007:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873778560:0@lo:400: 00000100:00100000:3.0:1784045255.318027:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045255.318045:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873779072:0@lo:400: 00000100:00100000:3.0:1784045255.318074:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045255.318097:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873778048 00000100:00100000:3.0:1784045255.318101:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873778048 00000100:00100000:3.0:1784045255.318127:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784045255.318133:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873778048:12345-0@lo:400: 00000100:00100000:3.0:1784045255.318169:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873778048:12345-0@lo:400: Request processed in 36us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.318174:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784045255.318192:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873778176 00000100:00100000:3.0:1784045255.318195:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873778176 00000100:00100000:3.0:1784045255.318210:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873778688 00000100:00100000:3.0:1784045255.318213:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873778688 00000100:00100000:3.0:1784045255.318224:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784045255.318229:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873778176:12345-0@lo:400: 00000100:00100000:3.0:1784045255.318257:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873778176:12345-0@lo:400: Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.318262:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784045255.318273:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784045255.318278:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873778688:12345-0@lo:400: 00000100:00100000:3.0:1784045255.318324:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873778688:12345-0@lo:400: Request processed in 44us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.318330:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784045255.318361:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873778048:0@lo:400: 00010000:00080000:3.0:1784045255.318375:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83382300 x1870706873778176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045255.318384:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873778176:0@lo:400: 00010000:00080000:3.0:1784045255.318406:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83381180 x1870706873778688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045255.318413:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873778688:0@lo:400: 00000100:00100000:3.0:1784045255.318476:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873778560 00000100:00100000:3.0:1784045255.318480:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873778560 00000100:00100000:3.0:1784045255.318498:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873779072 00000100:00100000:3.0:1784045255.318500:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873779072 00000100:00100000:3.0:1784045255.318511:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784045255.318517:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873778560:12345-0@lo:400: 00000100:00100000:3.0:1784045255.318551:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf435f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873778560:12345-0@lo:400: Request processed in 34us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.318558:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784045255.318570:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784045255.318575:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873779072:12345-0@lo:400: 00000100:00100000:3.0:1784045255.318603:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873779072:12345-0@lo:400: Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.318608:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1784045255.318636:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83381f80 x1870706873778560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045255.318645:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873778560:0@lo:400: 00010000:00080000:3.0:1784045255.318654:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83383800 x1870706873779072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045255.318660:0:3624:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1784045255.318669:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873779072:0@lo:400: 00010000:00080000:3.0:1784045255.318711:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83381c00 x1870706873777792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045255.318727:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873777792:0@lo:400: 00010000:00080000:3.0:1784045255.318740:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83380000 x1870706873778304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045255.318748:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873778304:0@lo:400: 00010000:00080000:3.0:1784045255.318757:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83380e00 x1870706873778816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045255.318764:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873778816:0@lo:400: 00010000:00080000:3.0:1784045255.318775:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83383b80 x1870706873777920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045255.318782:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873777920:0@lo:400: 00010000:00080000:3.0:1784045255.318791:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83383100 x1870706873778432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045255.318798:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873778432:0@lo:400: 00010000:00080000:3.0:1784045255.318812:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83380380 x1870706873778944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045255.318818:0:3626:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784045255.318828:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873778944:0@lo:400: 00000100:00080000:2.0:1784045255.319298:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045255.319303:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045255.319315:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045255.319317:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045255.319334:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873777664 00000100:00100000:2.0:1784045255.319339:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873777664 00000100:00100000:2.0:1784045255.319378:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784045255.319384:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873777664:12345-0@lo:400: 00000100:00100000:2.0:1784045255.319433:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873777664:12345-0@lo:400: Request processed in 50us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045255.319439:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1784045255.319725:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873777664:0@lo:400: 00010000:00010000:0.0:1784045255.637838:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045255.827916:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045255.827943:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873779328:0@lo:13: 00000100:00100000:3.0:1784045255.828013:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045255.828101:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873779200:0@lo:13: 00000100:00100000:3.0:1784045255.828128:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045255.828161:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873779328 00000100:00100000:3.0:1784045255.828169:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873779328 00000100:00100000:3.0:1784045255.828208:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873779200 00000100:00100000:3.0:1784045255.828211:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873779200 00000100:00100000:3.0:1784045255.828227:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784045255.828235:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873779328:12345-0@lo:13: 00002000:00000024:3.0:1784045255.828264:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045255.828321:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873779328:12345-0@lo:13: Request processed in 86us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.828328:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784045255.828344:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784045255.828350:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873779200:12345-0@lo:13: 00002000:00000024:3.0:1784045255.828361:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045255.828390:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873779200:12345-0@lo:13: Request processed in 40us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.828396:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1784045255.828428:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b5180 x1870706873779328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045255.828469:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873779328:0@lo:13: 00010000:00080000:3.0:1784045255.828499:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8dc00 x1870706873779200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045255.828510:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873779200:0@lo:13: 00000100:00100000:3.0:1784045255.893152:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045255.893201:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045255.893339:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863245696 00000100:00100000:0.0:1784045255.893349:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863245696 00000100:00100000:0.0:1784045255.893429:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863245440 00000100:00100000:0.0:1784045255.893433:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863245440 00000100:00100000:0.0:1784045255.893499:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:0.0:1784045255.893508:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:0:x1870706863245696:12345-192.168.203.44@tcp:41: 00000100:00080000:2.0:1784045255.893755:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045255.893759:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1784045255.893965:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045255.894035:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:0:x1870706863245696:12345-192.168.203.44@tcp:41: Request processed in 527us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.894043:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:0.0:1784045255.894061:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:0.0:1784045255.894068:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:0:x1870706863245440:12345-192.168.203.44@tcp:41: 00000004:00000024:0.0:1784045255.894086:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1784045255.894109:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:0:x1870706863245440:12345-192.168.203.44@tcp:41: Request processed in 41us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.894115:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:2.0:1784045255.905682:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045255.905765:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863245824 00000100:00100000:3.0:1784045255.905773:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863245824 00000100:00100000:3.0:1784045255.905828:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:3.0:1784045255.905837:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6152:x1870706863245824:12345-192.168.203.44@tcp:41: 00000004:00000024:3.0:1784045255.905864:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1784045255.905931:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6152:x1870706863245824:12345-192.168.203.44@tcp:41: Request processed in 95us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.905937:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:3.0:1784045255.910911:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045255.911035:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863245952 00000100:00100000:1.0:1784045255.911045:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863245952 00000100:00100000:1.0:1784045255.911108:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:1.0:1784045255.911119:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6152:x1870706863245952:12345-192.168.203.44@tcp:40: 00000100:00100000:1.0:1784045255.911216:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6152:x1870706863245952:12345-192.168.203.44@tcp:40: Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045255.911224:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:2.0:1784045255.915873:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045255.915924:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045255.915956:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045255.915979:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045255.916113:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863246336 00000100:00100000:0.0:1784045255.916123:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863246336 00000100:00100000:0.0:1784045255.916182:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:0.0:1784045255.916192:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6152:x1870706863246336:12345-192.168.203.44@tcp:900: 00000100:00100000:0.0:1784045255.916278:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6152:x1870706863246336:12345-192.168.203.44@tcp:900: Request processed in 87us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045255.916295:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:3.0:1784045255.916608:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863246080 00000100:00100000:3.0:1784045255.916613:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863246080 00000100:00100000:3.0:1784045255.916643:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863246208 00000100:00100000:3.0:1784045255.916646:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863246208 00000100:00100000:3.0:1784045255.916664:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:3.0:1784045255.916669:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1870706863246080:12345-192.168.203.44@tcp:8: 00010000:00080000:3.0:1784045255.916694:0:8413:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1784045255.916722:0:8413:0:(genops.c:1406:class_connect()) connect: client bbcbf11d-b5f2-42a6-9759-7590eb85aa60, cookie 0x5475624df454c5bf 00002000:00100000:3.0:1784045255.916737:0:8413:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bbcbf11d-b5f2-42a6-9759-7590eb85aa60/ffff939b833a9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784045255.916754:0:8413:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:3.0:1784045255.916942:0:8413:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784045255.916969:0:8413:0:(import.c:65:import_set_state_nolock()) ffff939b833a9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045255.917007:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2393:x1870706863246080:12345-192.168.203.44@tcp:8: Request processed in 337us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.917014:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:3.0:1784045255.917028:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:3.0:1784045255.917032:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1870706863246208:12345-192.168.203.44@tcp:8: 00010000:00080000:3.0:1784045255.917056:0:8413:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1784045255.917072:0:8413:0:(genops.c:1406:class_connect()) connect: client bbcbf11d-b5f2-42a6-9759-7590eb85aa60, cookie 0x5475624df454c5c6 00002000:00100000:3.0:1784045255.917079:0:8413:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bbcbf11d-b5f2-42a6-9759-7590eb85aa60/ffff939b833ad000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784045255.917085:0:8413:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1784045255.917191:0:8413:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784045255.917207:0:8413:0:(import.c:65:import_set_state_nolock()) ffff939b833ae800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045255.917229:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2393:x1870706863246208:12345-192.168.203.44@tcp:8: Request processed in 195us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045255.917236:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:1.0:1784045255.917345:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863246464 00000100:00100000:1.0:1784045255.917350:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863246464 00000100:00100000:1.0:1784045255.917410:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 194 00000100:00100000:1.0:1784045255.917417:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2394:x1870706863246464:12345-192.168.203.44@tcp:400: 00000100:00100000:1.0:1784045255.917483:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2394:x1870706863246464:12345-192.168.203.44@tcp:400: Request processed in 28us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045255.917490:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 194 00000100:00100000:2.0:1784045255.928301:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045255.928614:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863246592 00000100:00100000:1.0:1784045255.928623:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863246592 00000100:00100000:1.0:1784045255.928731:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:1.0:1784045255.928742:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6152:x1870706863246592:12345-192.168.203.44@tcp:33: 00000004:00080000:1.0:1784045255.971679:0:6499:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 42852us 00000004:00200000:2.0:1784045256.015768:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784045256.015932:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6152:x1870706863246592:12345-192.168.203.44@tcp:33: Request processed in 87183us (87642us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045256.015952:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:2.0:1784045256.253188:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045256.253317:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863246720 00000100:00100000:0.0:1784045256.253331:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863246720 00000100:00100000:0.0:1784045256.253423:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:0.0:1784045256.253437:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6193:x1870706863246720:12345-192.168.203.44@tcp:101: 00010000:00010000:0.0:1784045256.253513:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045256.253687:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab600/0x5475624df454c5cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73edb9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045256.253805:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c5d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045256.253820:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045256.253837:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045256.253888:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784045256.253892:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784045256.253908:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045256.253936:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab600/0x5475624df454c5cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edb9 expref: 8 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045256.253956:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edb9 expref: 7 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045256.253965:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c813ee300) 00010000:00010000:0.0:1784045256.253967:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784045256.253971:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915abe00, rc 0) 00000100:00100000:0.0:1784045256.254047:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:6193:x1870706863246720:12345-192.168.203.44@tcp:101: Request processed in 614us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045256.254056:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 13 00010000:00010000:1.0:1784045256.659694:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045257.683755:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045258.389326:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873779456:0@lo:13: 00000100:00100000:3.0:1784045258.389433:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045258.390154:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873779456 00000100:00100000:1.0:1784045258.390167:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873779456 00000100:00100000:1.0:1784045258.390241:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784045258.390254:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873779456:12345-0@lo:13: 00002000:00000024:1.0:1784045258.390413:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045258.390520:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873779456:12345-0@lo:13: Request processed in 268us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045258.390528:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1784045258.390851:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b8199bb80 x1870706873779456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045258.390876:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873779456:0@lo:13: 00000100:00080000:2.0:1784045258.393123:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045258.393530:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045258.393570:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873779584:0@lo:13: 00000100:00100000:0.0:1784045258.393697:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045258.394416:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873779584 00000100:00100000:1.0:1784045258.394428:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873779584 00000100:00100000:1.0:1784045258.394536:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784045258.394559:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873779584:12345-0@lo:13: 00002000:00000024:1.0:1784045258.394612:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045258.394985:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873779584:12345-0@lo:13: Request processed in 427us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045258.395004:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1784045258.395100:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784045258.395475:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b81999180 x1870706873779584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045258.395503:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873779584:0@lo:13: 00000100:00100000:0.0:1784045258.580414:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045258.580558:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863246848 00000100:00100000:3.0:1784045258.580571:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863246848 00000100:00100000:3.0:1784045258.580661:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:3.0:1784045258.580674:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:6245:x1870706863246848:12345-192.168.203.44@tcp:41: 00000004:00000024:3.0:1784045258.580734:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1784045258.580824:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:6245:x1870706863246848:12345-192.168.203.44@tcp:41: Request processed in 152us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045258.580851:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00080000:2.0:1784045258.582817:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045258.583637:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045258.583740:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863246976 00000100:00100000:0.0:1784045258.583749:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863246976 00000100:00100000:0.0:1784045258.583818:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:0.0:1784045258.583828:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6245:x1870706863246976:12345-192.168.203.44@tcp:41: 00000004:00000024:0.0:1784045258.583865:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045258.583940:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6245:x1870706863246976:12345-192.168.203.44@tcp:41: Request processed in 113us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045258.583947:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00080000:2.0:1784045258.584611:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045258.591061:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045258.591890:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863247104 00000100:00100000:1.0:1784045258.591906:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863247104 00000100:00100000:1.0:1784045258.592021:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:1.0:1784045258.592033:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6245:x1870706863247104:12345-192.168.203.44@tcp:13: 00002000:00000024:1.0:1784045258.592069:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1784045258.592226:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045258.592388:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6245:x1870706863247104:12345-192.168.203.44@tcp:13: Request processed in 356us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045258.592397:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:1.0:1784045258.617176:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045258.617329:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863247232 00000100:00100000:0.0:1784045258.617343:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863247232 00000100:00100000:0.0:1784045258.617465:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:0.0:1784045258.617479:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6245:x1870706863247232:12345-192.168.203.44@tcp:13: 00002000:00000024:0.0:1784045258.617592:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045258.617875:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:6245:x1870706863247232:12345-192.168.203.44@tcp:13: Request processed in 398us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045258.617885:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00080000:2.0:1784045258.618118:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784045258.708120:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045258.902928:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873779712:0@lo:41: 00000100:00100000:3.0:1784045258.903028:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045258.903172:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873779712 00000100:00100000:2.0:1784045258.903183:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873779712 00000100:00100000:2.0:1784045258.903256:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784045258.903275:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873779712:12345-0@lo:41: 00000004:00000024:2.0:1784045258.903328:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784045258.905229:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873779712:12345-0@lo:41: Request processed in 1949us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045258.905246:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784045258.905397:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873779712:0@lo:41: 00010000:00010000:2.0:1784045259.731829:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784045259.932716:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000100:00100000:1.0:1784045260.435924:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873780224:0@lo:400: 00000100:00100000:1.0:1784045260.436033:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045260.436104:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873780736:0@lo:400: 00000100:00100000:1.0:1784045260.436133:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045260.436160:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873781248:0@lo:400: 00000100:00100000:1.0:1784045260.436182:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045260.436213:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784045260.436219:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873780096:0@lo:400: 00000100:00100000:1.0:1784045260.436247:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045260.436281:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873780608:0@lo:400: 00000100:00100000:1.0:1784045260.436331:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045260.436349:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873781120:0@lo:400: 00000100:00100000:1.0:1784045260.436370:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045260.436399:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873780224 00000100:00100000:1.0:1784045260.436407:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873780224 00000100:00100000:1.0:1784045260.436485:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873780608 00000100:00100000:1.0:1784045260.436488:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873780608 00000100:00100000:1.0:1784045260.436508:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873781120 00000100:00100000:1.0:1784045260.436510:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873781120 00000100:00100000:1.0:1784045260.436538:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784045260.436547:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873780224:12345-0@lo:400: 00000100:00100000:1.0:1784045260.436600:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873780224:12345-0@lo:400: Request processed in 53us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045260.436607:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784045260.436633:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784045260.436639:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873780608:12345-0@lo:400: 00000100:00100000:1.0:1784045260.436661:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873780608:12345-0@lo:400: Request processed in 23us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045260.436667:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784045260.436676:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784045260.436680:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873781120:12345-0@lo:400: 00000100:00100000:1.0:1784045260.436699:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873781120:12345-0@lo:400: Request processed in 18us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045260.436704:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784045260.436721:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873780096 00000100:00100000:1.0:1784045260.436724:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873780096 00000100:00100000:1.0:1784045260.436745:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784045260.436751:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873780096:12345-0@lo:400: 00000100:00100000:1.0:1784045260.436777:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873780096:12345-0@lo:400: Request processed in 26us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045260.436782:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784045260.436823:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873780096:0@lo:400: 00010000:00080000:1.0:1784045260.436848:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b6d80 x1870706873780608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045260.436860:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873780608:0@lo:400: 00010000:00080000:1.0:1784045260.436870:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b7b80 x1870706873781120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045260.436879:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873781120:0@lo:400: 00000100:00100000:1.0:1784045260.436890:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873780224:0@lo:400: 00000100:00100000:3.0:1784045260.437396:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873779968:0@lo:400: 00000100:00100000:3.0:1784045260.437467:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045260.437501:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873780480:0@lo:400: 00000100:00100000:3.0:1784045260.437524:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045260.437535:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873780992:0@lo:400: 00000100:00100000:1.0:1784045260.437566:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873779968 00000100:00100000:1.0:1784045260.437572:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873779968 00000100:00100000:1.0:1784045260.437595:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873780480 00000100:00100000:1.0:1784045260.437597:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873780480 00000100:00100000:1.0:1784045260.437611:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784045260.437617:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873779968:12345-0@lo:400: 00000100:00100000:1.0:1784045260.437656:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873779968:12345-0@lo:400: Request processed in 37us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045260.437663:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784045260.437683:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784045260.437685:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045260.437692:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873780480:12345-0@lo:400: 00000100:00100000:3.0:1784045260.437709:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873781504:0@lo:41: 00000100:00100000:1.0:1784045260.437723:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873780480:12345-0@lo:400: Request processed in 32us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045260.437729:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784045260.437741:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045260.437741:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873780992 00000100:00100000:1.0:1784045260.437744:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873780992 00000100:00100000:1.0:1784045260.437767:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784045260.437774:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873780992:12345-0@lo:400: 00000100:00100000:3.0:1784045260.437778:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873779968:0@lo:400: 00000100:00100000:3.0:1784045260.437791:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873780480:0@lo:400: 00000100:00100000:3.0:1784045260.437806:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1784045260.437813:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873779840:0@lo:400: 00000100:00100000:3.0:1784045260.437839:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045260.437864:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873780352:0@lo:400: 00000100:00100000:3.0:1784045260.437881:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045260.437896:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873780864:0@lo:400: 00000100:00100000:3.0:1784045260.438087:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045260.438105:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873781376:0@lo:400: 00000100:00100000:3.0:1784045260.438244:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045260.438287:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873780736 00000100:00100000:3.0:1784045260.438292:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873780736 00000100:00100000:3.0:1784045260.438388:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873781248 00000100:00100000:3.0:1784045260.438392:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873781248 00000100:00100000:3.0:1784045260.438411:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873780864 00000100:00100000:3.0:1784045260.438414:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873780864 00000100:00100000:3.0:1784045260.438425:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873781376 00000100:00100000:3.0:1784045260.438428:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873781376 00000100:00100000:3.0:1784045260.438442:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784045260.438475:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873780736:12345-0@lo:400: 00000100:00100000:3.0:1784045260.438517:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873780736:12345-0@lo:400: Request processed in 44us (2384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045260.438524:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1784045260.438633:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045260.438640:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045260.438643:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045260.438646:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045260.438660:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873781504 00000100:00100000:2.0:1784045260.438664:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873781504 00000100:00100000:1.0:1784045260.438670:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873780992:12345-0@lo:400: Request processed in 894us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045260.438679:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784045260.438700:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873780352 00000100:00100000:2.0:1784045260.438704:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873780352 00000100:00100000:0.0:1784045260.438771:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045260.438780:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873781248:12345-0@lo:400: 00000100:00100000:0.0:1784045260.438817:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873781248:12345-0@lo:400: Request processed in 40us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045260.438824:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045260.438835:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045260.438847:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873780864:12345-0@lo:400: 00000100:00100000:2.0:1784045260.438873:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784045260.438880:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873781504:12345-0@lo:41: 00000004:00000024:2.0:1784045260.438911:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1784045260.438947:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873781504:12345-0@lo:41: Request processed in 68us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045260.438952:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784045260.438965:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784045260.438969:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873780352:12345-0@lo:400: 00000100:00100000:2.0:1784045260.438991:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873780352:12345-0@lo:400: Request processed in 22us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045260.438997:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784045260.439013:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784045260.439026:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873781376:12345-0@lo:400: 00000100:00100000:2.0:1784045260.439052:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873781376:12345-0@lo:400: Request processed in 27us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045260.439057:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784045260.439476:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873780864:12345-0@lo:400: Request processed in 627us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045260.439483:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045260.439519:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873779840 00000100:00100000:0.0:1784045260.439523:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873779840 00000100:00100000:0.0:1784045260.439573:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1784045260.439579:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873779840:12345-0@lo:400: 00000100:00100000:0.0:1784045260.439611:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873779840:12345-0@lo:400: Request processed in 32us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045260.439617:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00010000:00080000:0.0:1784045260.439681:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b7480 x1870706873780736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045260.439696:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873780736:0@lo:400: 00010000:00080000:0.0:1784045260.439713:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b6680 x1870706873781248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045260.439722:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873781248:0@lo:400: 00000100:00100000:2.0:1784045260.440836:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873779840:0@lo:400: 00000100:00100000:2.0:1784045260.440854:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873780352:0@lo:400: 00010000:00080000:2.0:1784045260.440869:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b5880 x1870706873780864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045260.440879:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873780864:0@lo:400: 00010000:00080000:2.0:1784045260.440891:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b6300 x1870706873781376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045260.440900:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873781376:0@lo:400: 00000100:00100000:2.0:1784045260.440919:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873781504:0@lo:41: 00000100:00100000:2.0:1784045260.440932:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873780992:0@lo:400: 00010000:00010000:0.0:1784045260.756533:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045260.947988:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873781632:0@lo:13: 00000100:00100000:3.0:1784045260.948084:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045260.948287:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873781632 00000100:00100000:1.0:1784045260.948297:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873781632 00000100:00100000:1.0:1784045260.948364:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784045260.948375:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873781632:12345-0@lo:13: 00002000:00000024:1.0:1784045260.948411:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045260.948491:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873781632:12345-0@lo:13: Request processed in 117us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045260.948499:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1784045260.948548:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6927100 x1870706873781632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045260.948567:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873781632:0@lo:13: 00000100:00100000:1.0:1784045260.948872:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045260.948881:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873781760:0@lo:13: 00000100:00100000:1.0:1784045260.948909:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045260.949037:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873781760 00000100:00100000:3.0:1784045260.949042:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873781760 00000100:00100000:3.0:1784045260.949076:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784045260.949083:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873781760:12345-0@lo:13: 00002000:00000024:3.0:1784045260.949095:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045260.949126:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6927100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873781760:12345-0@lo:13: Request processed in 44us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045260.949132:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1784045260.949195:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b8199bb80 x1870706873781760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045260.949207:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873781760:0@lo:13: 00000001:00100000:2.0:1784045260.951595:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000001:00100000:3.0:1784045260.951906:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000100:00100000:2.0:1784045260.995189:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045260.995242:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045260.995314:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863247616 00000100:00100000:1.0:1784045260.995328:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863247616 00000100:00100000:1.0:1784045260.995432:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:1.0:1784045260.995480:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863247616:12345-192.168.203.44@tcp:400: 00000100:00100000:3.0:1784045260.995482:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863247360 00000100:00100000:3.0:1784045260.995489:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863247360 00000100:00100000:3.0:1784045260.995541:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 196 00000100:00100000:3.0:1784045260.995550:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2394:x1870706863247360:12345-192.168.203.44@tcp:400: 00000100:00100000:1.0:1784045260.995589:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863247616:12345-192.168.203.44@tcp:400: Request processed in 146us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045260.995607:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2394:x1870706863247360:12345-192.168.203.44@tcp:400: Request processed in 57us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045260.995608:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:3.0:1784045260.995620:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 196 00000100:00100000:2.0:1784045260.995772:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045260.995994:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863247872 00000100:00100000:3.0:1784045260.995999:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863247872 00000100:00100000:3.0:1784045260.996051:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:3.0:1784045260.996060:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863247872:12345-192.168.203.44@tcp:400: 00000100:00100000:2.0:1784045260.996074:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045260.996131:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863247488 00000100:00100000:0.0:1784045260.996137:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863247488 00000100:00100000:0.0:1784045260.996174:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:0.0:1784045260.996181:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863247488:12345-192.168.203.44@tcp:400: 00000100:00100000:3.0:1784045260.996236:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863247872:12345-192.168.203.44@tcp:400: Request processed in 176us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045260.996245:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00080000:1.0:1784045260.996582:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045260.996589:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045260.996596:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045260.997533:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045260.997618:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863247744 00000100:00100000:1.0:1784045260.997627:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863247744 00000100:00100000:1.0:1784045260.997702:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:1.0:1784045260.997712:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863247744:12345-192.168.203.44@tcp:400: 00000100:00100000:1.0:1784045260.997781:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863247744:12345-192.168.203.44@tcp:400: Request processed in 70us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045260.997788:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00080000:2.0:1784045260.997876:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045260.997928:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863247488:12345-192.168.203.44@tcp:400: Request processed in 1745us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045260.997938:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 51 00010000:00010000:0.0:1784045261.781546:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784045261.844679:0:10163:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1784045261.976495:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00010000:00010000:3.0:1784045262.807133:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045263.508262:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873781888:0@lo:13: 00000100:00100000:0.0:1784045263.508330:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045263.509184:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873781888 00000100:00100000:3.0:1784045263.509201:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873781888 00000100:00080000:1.0:1784045263.509304:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045263.509320:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784045263.509336:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873781888:12345-0@lo:13: 00002000:00000024:3.0:1784045263.509377:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045263.509527:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873781888:12345-0@lo:13: Request processed in 195us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045263.509536:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1784045263.509809:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6925f80 x1870706873781888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045263.509833:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873781888:0@lo:13: 00000100:00100000:0.0:1784045263.512866:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045263.512888:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873782016:0@lo:13: 00000100:00100000:0.0:1784045263.512951:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045263.513907:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873782016 00000100:00100000:2.0:1784045263.513917:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873782016 00000100:00100000:2.0:1784045263.513989:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784045263.514011:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873782016:12345-0@lo:13: 00002000:00000024:2.0:1784045263.514035:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045263.514108:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873782016:12345-0@lo:13: Request processed in 98us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045263.514115:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1784045263.514158:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d6300 x1870706873782016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045263.514177:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873782016:0@lo:13: 00000100:00080000:1.0:1784045263.514329:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784045263.827738:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045264.032808:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045264.032838:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873782144:0@lo:41: 00000100:00100000:0.0:1784045264.032905:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045264.032971:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873782144 00000100:00100000:0.0:1784045264.032978:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873782144 00000100:00100000:0.0:1784045264.033020:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784045264.033029:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873782144:12345-0@lo:41: 00000004:00000024:0.0:1784045264.033063:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045264.033104:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873782144:12345-0@lo:41: Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045264.033111:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784045264.033153:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873782144:0@lo:41: 00010000:00010000:2.0:1784045264.852914:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784045265.215991:0:10311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe65046e70 20000000:00000080:0.0:1784045265.216009:0:10311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939cb6878400 uarg=0000000000000000 20000000:01000000:0.0:1784045265.216060:0:10311:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1784045265.216063:0:10311:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1784045265.216072:0:10311:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784045265.216077:0:10311:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784045265.216081:0:10311:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1784045265.216139:0:10311:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784045265.216142:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784045265.218924:0:10312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1784045265.219189:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1784045265.219220:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1784045265.219254:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1784045265.219283:0:10311:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1784045265.219286:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784045265.228166:0:10313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1784045265.228618:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1784045265.228906:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1784045265.228933:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1784045265.228948:0:10311:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784045265.228950:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784045265.229267:0:10314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1784045265.229433:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1784045265.229583:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1784045265.229599:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1784045265.229609:0:10311:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784045265.229611:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784045265.234325:0:10315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1784045265.235265:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1784045265.235300:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1784045265.235317:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1784045265.235343:0:10311:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784045265.235346:0:10311:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784045265.239043:0:10316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1784045265.239331:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1784045265.239361:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1784045265.239378:0:10311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:2.0:1784045265.239395:0:10311:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784045265.239416:0:10311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.239433:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b81987800/0x5475624df454c476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c46f expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.240525:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc2170200/0x5475624df454c4a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c499 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.240533:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc2170a00/0x5475624df454c4df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c4d8 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.240540:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc106e000/0x5475624df454c4ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c4e6 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.240547:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc106fa00/0x5475624df454c4fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c4f4 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.240554:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c915aa800/0x5475624df454c517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c510 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.240561:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc2171400/0x5475624df454c541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c53a expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.240567:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b81987200/0x5475624df454c55d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c556 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.240574:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b81987c00/0x5475624df454c587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c580 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.240583:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c915aba00/0x5475624df454c595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ed49 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.240590:0:10311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b81986a00/0x5475624df454c59c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ed50 expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.240611:0:10311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.240665:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b81986a00/0x5475624df454c59c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed50 expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.240820:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939b81986a00/0x5475624df454c59c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed50 expref: 9 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.240896:0:10311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873782272:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045265.241062:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c915aba00/0x5475624df454c595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed49 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.241070:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939c915aba00/0x5475624df454c595 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed49 expref: 9 pid: 6488 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.241079:0:10311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873782400:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045265.241112:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b81987c00/0x5475624df454c587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c580 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.241120:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939b81987c00/0x5475624df454c587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c580 expref: 23 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.241127:0:10311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873782528:0@lo:104: 00000100:00100000:2.0:1784045265.241166:0:10311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045265.241212:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b81987200/0x5475624df454c55d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c556 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.241252:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939b81987200/0x5475624df454c55d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c556 expref: 23 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.241259:0:10311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873782656:0@lo:104: 00000100:00100000:2.0:1784045265.241283:0:10311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045265.241309:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc2171400/0x5475624df454c541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c53a expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.241317:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc2171400/0x5475624df454c541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c53a expref: 23 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.241324:0:10311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873782784:0@lo:104: 00000100:00100000:2.0:1784045265.241344:0:10311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045265.241359:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c915aa800/0x5475624df454c517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c510 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.241367:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c915aa800/0x5475624df454c517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c510 expref: 23 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.241375:0:10311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873782912:0@lo:104: 00000100:00100000:2.0:1784045265.241396:0:10311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045265.241413:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc106fa00/0x5475624df454c4fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c4f4 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.241420:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc106fa00/0x5475624df454c4fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c4f4 expref: 23 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.241429:0:10311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873783040:0@lo:104: 00010000:00010000:2.0:1784045265.241495:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc106e000/0x5475624df454c4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c4e6 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.241503:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc106e000/0x5475624df454c4ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c4e6 expref: 23 pid: 6490 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.241512:0:10311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873783168:0@lo:104: 00010000:00010000:2.0:1784045265.241531:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc2170a00/0x5475624df454c4df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c4d8 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.241538:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc2170a00/0x5475624df454c4df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c4d8 expref: 23 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.241545:0:10311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873783296:0@lo:104: 00010000:00010000:2.0:1784045265.241566:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc2170200/0x5475624df454c4a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c499 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.241572:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc2170200/0x5475624df454c4a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c499 expref: 23 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.241579:0:10311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873783424:0@lo:104: 00010000:00010000:2.0:1784045265.241598:0:10311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b81987800/0x5475624df454c476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c46f expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045265.241606:0:10311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939b81987800/0x5475624df454c476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c46f expref: 23 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.241613:0:10311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873783552:0@lo:104: 00000100:00100000:2.0:1784045265.241630:0:10311:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a60480 going to sleep for 11 seconds 00000100:00100000:3.0:1784045265.241723:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784045265.241741:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.241754:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.241761:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.241769:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.241776:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.241783:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873782528 00000100:00100000:3.0:1784045265.241790:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873782528 00000100:00100000:3.0:1784045265.241839:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873782656 00000100:00100000:3.0:1784045265.241842:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873782656 00000100:00100000:3.0:1784045265.241851:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873782784 00000100:00100000:3.0:1784045265.241853:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873782784 00000100:00100000:3.0:1784045265.241861:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873782912 00000100:00100000:3.0:1784045265.241863:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873782912 00000100:00100000:3.0:1784045265.241870:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873783040 00000100:00100000:3.0:1784045265.241872:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873783040 00000100:00100000:3.0:1784045265.241880:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873783168 00000100:00100000:3.0:1784045265.241882:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873783168 00000100:00100000:3.0:1784045265.241890:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873783296 00000100:00100000:3.0:1784045265.241892:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873783296 00000100:00100000:3.0:1784045265.241901:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873783424 00000100:00100000:3.0:1784045265.241903:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873783424 00000100:00100000:3.0:1784045265.241911:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873783552 00000100:00100000:3.0:1784045265.241913:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873783552 00000100:00100000:3.0:1784045265.241926:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784045265.241934:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+11:10311:x1870706873782528:12345-0@lo:104: 00010000:00010000:3.0:1784045265.241947:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c587 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242028:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784045265.242034:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+11:10311:x1870706873782528:12345-0@lo:104: Request processed in 101us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.242041:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784045265.242059:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784045265.242065:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+10:10311:x1870706873782656:12345-0@lo:104: 00010000:00010000:3.0:1784045265.242073:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c55d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242105:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784045265.242111:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+10:10311:x1870706873782656:12345-0@lo:104: Request processed in 46us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.242117:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784045265.242128:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784045265.242133:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+9:10311:x1870706873782784:12345-0@lo:104: 00010000:00010000:3.0:1784045265.242141:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c541 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242172:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784045265.242177:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+9:10311:x1870706873782784:12345-0@lo:104: Request processed in 44us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.242182:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784045265.242193:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784045265.242198:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6858450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+8:10311:x1870706873782912:12345-0@lo:104: 00010000:00010000:3.0:1784045265.242204:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c517 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242248:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1784045265.242254:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6858450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+8:10311:x1870706873782912:12345-0@lo:104: Request processed in 56us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.242260:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784045265.242293:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784045265.242298:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+7:10311:x1870706873783040:12345-0@lo:104: 00010000:00010000:3.0:1784045265.242305:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c4fb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242327:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1784045265.242331:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+7:10311:x1870706873783040:12345-0@lo:104: Request processed in 34us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.242336:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784045265.242346:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784045265.242351:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1375180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+6:10311:x1870706873783168:12345-0@lo:104: 00010000:00010000:3.0:1784045265.242357:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c4ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242377:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1784045265.242381:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1375180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+6:10311:x1870706873783168:12345-0@lo:104: Request processed in 31us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.242387:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784045265.242396:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784045265.242401:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:10311:x1870706873783296:12345-0@lo:104: 00010000:00010000:3.0:1784045265.242407:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c4df expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242438:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1784045265.242468:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:10311:x1870706873783296:12345-0@lo:104: Request processed in 42us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.242474:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784045265.242486:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784045265.242492:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:10311:x1870706873783424:12345-0@lo:104: 00010000:00010000:3.0:1784045265.242499:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c4a0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242523:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1784045265.242528:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1376d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:10311:x1870706873783424:12345-0@lo:104: Request processed in 36us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.242532:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784045265.242542:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784045265.242547:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:10311:x1870706873783552:12345-0@lo:104: 00010000:00010000:3.0:1784045265.242554:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c476 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242578:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1784045265.242583:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1375500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:10311:x1870706873783552:12345-0@lo:104: Request processed in 36us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.242587:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1784045265.242604:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1784045265.242609:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c587 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242627:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915ab800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045265.242631:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c587 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242639:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c587 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045265.242646:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c587 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045265.242651:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045265.242680:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c587 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242687:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045265.242707:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c587 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242714:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915ab800/0x5475624df454c580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c587 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242729:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1784045265.242733:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c55d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242738:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986e00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045265.242741:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c55d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242757:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c55d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045265.242763:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c55d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045265.242768:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045265.242781:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c55d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242787:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045265.242802:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c55d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242809:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c556 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c55d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242818:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1784045265.242821:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c541 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242826:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045265.242829:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c541 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242835:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c541 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045265.242841:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c541 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045265.242854:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045265.242866:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c541 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242871:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045265.242877:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c541 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242882:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81986400/0x5475624df454c53a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c541 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242890:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1784045265.242893:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c517 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242898:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045265.242900:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c517 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242906:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c517 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045265.242912:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c517 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045265.242916:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045265.242925:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c517 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242929:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045265.242939:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c517 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242945:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc2171000/0x5475624df454c510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c517 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242958:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784045265.242960:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c4fb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242965:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045265.242968:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c4fb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.242975:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c4fb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045265.242980:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c4fb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045265.242985:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045265.242996:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c4fb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243001:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045265.243005:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c4fb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243011:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc2171600/0x5475624df454c4f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c4fb expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243020:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784045265.243029:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c4ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243035:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986c00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045265.243038:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c4ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243044:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c4ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045265.243050:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c4ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045265.243055:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045265.243067:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c4ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243072:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045265.243076:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c4ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243082:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c4e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c4ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243092:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784045265.243094:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c4df expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243100:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171a00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045265.243102:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c4df expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243118:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c4df expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045265.243123:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c4df expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045265.243128:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045265.243139:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c4df expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243145:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045265.243149:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c4df expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243155:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c4d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c4df expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243165:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045265.243167:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c4a0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243173:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aa200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045265.243176:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c4a0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243182:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c4a0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045265.243188:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c4a0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045265.243199:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045265.243213:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c4a0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243218:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045265.243223:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c4a0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243242:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915aa200/0x5475624df454c499 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c4a0 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243251:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045265.243254:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c476 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243259:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171e00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045265.243261:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c476 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243267:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c476 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045265.243273:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c476 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045265.243278:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045265.243303:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c476 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243309:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045265.243318:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c476 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243324:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc2171e00/0x5475624df454c46f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c476 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243338:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045265.243339:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045265.243341:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045265.243349:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045265.243354:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045265.243367:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873783680:0@lo:103: 00000100:00100000:3.0:1784045265.243409:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.243438:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873784192:0@lo:103: 00000100:00100000:3.0:1784045265.243477:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.243494:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873784704:0@lo:103: 00000100:00100000:3.0:1784045265.243526:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.243547:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784045265.243553:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873784064:0@lo:103: 00000100:00100000:3.0:1784045265.243572:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.243586:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873784576:0@lo:103: 00000100:00100000:3.0:1784045265.243603:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.243626:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873783808:0@lo:103: 00000100:00100000:3.0:1784045265.243643:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.243652:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873784320:0@lo:103: 00000100:00100000:3.0:1784045265.243669:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.243679:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784045265.243692:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873783936:0@lo:103: 00000100:00100000:3.0:1784045265.243713:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.243721:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873784448:0@lo:103: 00000100:00100000:3.0:1784045265.243734:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.243754:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873783680 00000100:00100000:3.0:1784045265.243759:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873783680 00010000:00010000:3.0:1784045265.243780:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b81987c00/0x5475624df454c587 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c580 expref: 24 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045265.243796:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873784192 00000100:00100000:3.0:1784045265.243798:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873784192 00010000:00010000:3.0:1784045265.243807:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc106fa00/0x5475624df454c4fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c4f4 expref: 25 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045265.243815:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873784704 00000100:00100000:3.0:1784045265.243817:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873784704 00010000:00010000:3.0:1784045265.243824:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b81987800/0x5475624df454c476 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c46f expref: 26 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045265.243831:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873784064 00000100:00100000:3.0:1784045265.243833:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873784064 00010000:00010000:3.0:1784045265.243840:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c915aa800/0x5475624df454c517 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c510 expref: 27 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045265.243847:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873784576 00000100:00100000:3.0:1784045265.243848:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873784576 00010000:00010000:3.0:1784045265.243855:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc2170200/0x5475624df454c4a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c499 expref: 28 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045265.243862:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873783808 00000100:00100000:3.0:1784045265.243863:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873783808 00010000:00010000:3.0:1784045265.243870:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b81987200/0x5475624df454c55d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c556 expref: 29 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045265.243887:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873784320 00000100:00100000:3.0:1784045265.243890:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873784320 00010000:00010000:3.0:1784045265.243900:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc106e000/0x5475624df454c4ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c4e6 expref: 30 pid: 6490 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045265.243907:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873783936 00000100:00100000:3.0:1784045265.243909:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873783936 00010000:00010000:3.0:1784045265.243917:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc2171400/0x5475624df454c541 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c53a expref: 31 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045265.243925:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873784448 00000100:00100000:3.0:1784045265.243926:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873784448 00010000:00010000:3.0:1784045265.243934:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc2170a00/0x5475624df454c4df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c4d8 expref: 32 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045265.243943:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784045265.243949:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+32:3624:x1870706873783680:12345-0@lo:103: 00010000:00010000:3.0:1784045265.243959:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045265.243964:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b81987c00/0x5475624df454c587 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c580 expref: 32 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243974:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b81987c00/0x5475624df454c587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c580 expref: 32 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.243990:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045265.244020:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+32:3624:x1870706873783680:12345-0@lo:103: Request processed in 70us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.244027:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784045265.244063:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784045265.244077:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+31:3624:x1870706873784192:12345-0@lo:103: 00010000:00010000:3.0:1784045265.244085:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045265.244089:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc106fa00/0x5475624df454c4fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c4f4 expref: 31 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244097:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc106fa00/0x5475624df454c4fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c4f4 expref: 31 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244107:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045265.244128:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+31:3624:x1870706873784192:12345-0@lo:103: Request processed in 53us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.244134:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784045265.244147:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784045265.244153:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+30:3624:x1870706873784704:12345-0@lo:103: 00010000:00010000:3.0:1784045265.244160:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045265.244163:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b81987800/0x5475624df454c476 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c46f expref: 30 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244171:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b81987800/0x5475624df454c476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c46f expref: 30 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244181:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045265.244202:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+30:3624:x1870706873784704:12345-0@lo:103: Request processed in 49us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.244208:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784045265.244219:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784045265.244236:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+29:3624:x1870706873784064:12345-0@lo:103: 00010000:00010000:3.0:1784045265.244244:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045265.244254:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c915aa800/0x5475624df454c517 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c510 expref: 29 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244263:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c915aa800/0x5475624df454c517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c510 expref: 29 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244272:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045265.244293:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+29:3624:x1870706873784064:12345-0@lo:103: Request processed in 69us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.244299:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784045265.244311:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784045265.244316:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83566d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+28:3624:x1870706873784576:12345-0@lo:103: 00010000:00010000:3.0:1784045265.244322:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045265.244326:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc2170200/0x5475624df454c4a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c499 expref: 28 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244334:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc2170200/0x5475624df454c4a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c499 expref: 28 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244342:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045265.244361:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83566d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+28:3624:x1870706873784576:12345-0@lo:103: Request processed in 45us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.244366:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784045265.244377:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784045265.244382:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83567480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+27:3625:x1870706873783808:12345-0@lo:103: 00010000:00010000:3.0:1784045265.244388:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045265.244392:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b81987200/0x5475624df454c55d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c556 expref: 27 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244411:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b81987200/0x5475624df454c55d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c556 expref: 27 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244421:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045265.244470:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83567480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+27:3625:x1870706873783808:12345-0@lo:103: Request processed in 88us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.244476:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784045265.244488:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784045265.244494:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+26:3625:x1870706873784320:12345-0@lo:103: 00010000:00010000:3.0:1784045265.244501:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045265.244506:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc106e000/0x5475624df454c4ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c4e6 expref: 26 pid: 6490 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244514:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc106e000/0x5475624df454c4ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c4e6 expref: 26 pid: 6490 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244522:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045265.244543:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+26:3625:x1870706873784320:12345-0@lo:103: Request processed in 49us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.244549:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784045265.244560:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784045265.244566:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+25:3625:x1870706873783936:12345-0@lo:103: 00010000:00010000:3.0:1784045265.244573:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045265.244576:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc2171400/0x5475624df454c541 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c53a expref: 25 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244584:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc2171400/0x5475624df454c541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c53a expref: 25 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244599:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045265.244622:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+25:3625:x1870706873783936:12345-0@lo:103: Request processed in 56us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.244628:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784045265.244651:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784045265.244657:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873784448:12345-0@lo:103: 00010000:00010000:3.0:1784045265.244664:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045265.244669:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc2170a00/0x5475624df454c4df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c4d8 expref: 24 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244677:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc2170a00/0x5475624df454c4df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c4d8 expref: 24 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.244686:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045265.244705:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873784448:12345-0@lo:103: Request processed in 48us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.244711:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784045265.244759:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873783936:0@lo:103: 00000100:00100000:3.0:1784045265.244768:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873784448:0@lo:103: 00000100:00100000:3.0:1784045265.244774:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873783808:0@lo:103: 00000100:00100000:3.0:1784045265.244781:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873784320:0@lo:103: 00000100:00100000:3.0:1784045265.244808:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873784064:0@lo:103: 00000100:00100000:3.0:1784045265.244815:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873784576:0@lo:103: 00000100:00100000:3.0:1784045265.244821:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873783680:0@lo:103: 00000100:00100000:3.0:1784045265.244836:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873784192:0@lo:103: 00000100:00100000:3.0:1784045265.244843:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873784704:0@lo:103: 00010000:00010000:2.0:1784045265.245119:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81987c00/0x5475624df454c587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c580 expref: 23 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.245131:0:10311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873782528:0@lo:104: 00010000:00010000:2.0:1784045265.245143:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81987200/0x5475624df454c55d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c556 expref: 22 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.245151:0:10311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873782656:0@lo:104: 00010000:00010000:2.0:1784045265.245161:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc2171400/0x5475624df454c541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c53a expref: 21 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.245169:0:10311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873782784:0@lo:104: 00010000:00010000:2.0:1784045265.245178:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915aa800/0x5475624df454c517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c510 expref: 20 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.245186:0:10311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873782912:0@lo:104: 00010000:00010000:2.0:1784045265.245194:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106fa00/0x5475624df454c4fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c4f4 expref: 19 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.245201:0:10311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873783040:0@lo:104: 00010000:00010000:2.0:1784045265.245209:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106e000/0x5475624df454c4ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c4e6 expref: 18 pid: 6490 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.245216:0:10311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873783168:0@lo:104: 00010000:00010000:2.0:1784045265.245223:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc2170a00/0x5475624df454c4df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c4d8 expref: 17 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.245242:0:10311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873783296:0@lo:104: 00010000:00010000:2.0:1784045265.245252:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc2170200/0x5475624df454c4a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c499 expref: 16 pid: 6489 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.245268:0:10311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873783424:0@lo:104: 00010000:00010000:2.0:1784045265.245278:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81987800/0x5475624df454c476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c46f expref: 15 pid: 6488 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045265.245285:0:10311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873783552:0@lo:104: 00000100:00100000:0.0:1784045265.256190:0:10311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873782272:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045265.257866:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045265.257968:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045265.257972:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863248000 00000100:00100000:0.0:1784045265.257978:0:10311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10311:1870706873782400:192.168.203.44@tcp:104: 00000100:00100000:1.0:1784045265.257981:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863248000 00010000:00010000:1.0:1784045265.258023:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b81986a00/0x5475624df454c59c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed50 expref: 10 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045265.258042:0:10311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045265.258062:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863248128 00000100:00100000:1.0:1784045265.258067:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863248128 00010000:00010000:1.0:1784045265.258081:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c915aba00/0x5475624df454c595 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed49 expref: 11 pid: 6488 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045265.258084:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:3.0:1784045265.258099:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:2395:x1870706863248000:12345-192.168.203.44@tcp:103: 00000100:00100000:1.0:1784045265.258108:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 34 00010000:00010000:3.0:1784045265.258118:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784045265.258119:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:2394:x1870706863248128:12345-192.168.203.44@tcp:103: 00010000:00010000:1.0:1784045265.258131:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045265.258132:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b81986a00/0x5475624df454c59c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed50 expref: 11 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045265.258140:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c915aba00/0x5475624df454c595 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed49 expref: 11 pid: 6488 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.258149:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b81986a00/0x5475624df454c59c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed50 expref: 11 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045265.259355:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c915aba00/0x5475624df454c595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed49 expref: 11 pid: 6488 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.259746:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81986a00/0x5475624df454c59c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed50 expref: 11 pid: 6489 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045265.259987:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915aba00/0x5475624df454c595 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed49 expref: 10 pid: 6488 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045265.260002:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045265.260012:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045265.260035:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045265.260043:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045265.260050:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045265.260057:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045265.260063:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986800 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045265.260068:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045265.260075:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045265.260115:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045265.260128:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045265.260371:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:2394:x1870706863248128:12345-192.168.203.44@tcp:103: Request processed in 2252us (2401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045265.260381:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 34 00010000:00010000:0.0:1784045265.262965:0:10311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045265.262983:0:10311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045265.262991:0:10311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81986800/0x5475624df454c5db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045265.264987:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045265.265071:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:019b5529-a0fa-4aaf-b296-1845dacd5d85+8:2395:x1870706863248000:12345-192.168.203.44@tcp:103: Request processed in 6969us (7206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045265.265085:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:3.0:1784045265.556295:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873784832:0@lo:41: 00000100:00100000:3.0:1784045265.556375:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045265.556531:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873784832 00000100:00100000:2.0:1784045265.556539:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873784832 00000100:00100000:2.0:1784045265.556592:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784045265.556603:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873784832:12345-0@lo:41: 00000004:00000024:2.0:1784045265.556646:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784045265.556698:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873784832:12345-0@lo:41: Request processed in 97us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045265.556706:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784045265.556726:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873784960:0@lo:400: 00000100:00100000:2.0:1784045265.556753:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045265.556774:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873785472:0@lo:400: 00000100:00100000:2.0:1784045265.556794:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045265.556816:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873785984:0@lo:400: 00000100:00100000:2.0:1784045265.556838:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.556888:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873785088:0@lo:400: 00000100:00100000:1.0:1784045265.556902:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873785216:0@lo:400: 00000100:00100000:3.0:1784045265.556929:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873785344:0@lo:400: 00000100:00100000:1.0:1784045265.556929:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045265.556946:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873785728:0@lo:400: 00000100:00100000:1.0:1784045265.556966:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045265.557037:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873786240:0@lo:400: 00000100:00100000:1.0:1784045265.557059:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045265.557083:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873784960 00000100:00100000:0.0:1784045265.557087:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873784960 00000100:00100000:0.0:1784045265.557115:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873785472 00000100:00100000:0.0:1784045265.557118:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873785472 00000100:00100000:0.0:1784045265.557159:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784045265.557166:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873784960:12345-0@lo:400: 00000100:00100000:0.0:1784045265.557203:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873784960:12345-0@lo:400: Request processed in 37us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045265.557208:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784045265.557239:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784045265.557245:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873785472:12345-0@lo:400: 00000100:00100000:0.0:1784045265.557274:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873785472:12345-0@lo:400: Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045265.557280:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784045265.557296:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873785216 00000100:00100000:0.0:1784045265.557299:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873785216 00000100:00100000:0.0:1784045265.557321:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784045265.557325:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873785216:12345-0@lo:400: 00000100:00100000:0.0:1784045265.557353:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873785216:12345-0@lo:400: Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045265.557358:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1784045265.557375:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045265.562552:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873784960:0@lo:400: 00010000:00080000:2.0:1784045265.562597:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820d180 x1870706873785472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045265.562621:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873785472:0@lo:400: 00000100:00100000:2.0:1784045265.562658:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045265.563419:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873785600:0@lo:400: 00000100:00100000:0.0:1784045265.563528:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873785984 00000100:00100000:0.0:1784045265.563536:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873785984 00000100:00100000:0.0:1784045265.563589:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873785088 00000100:00100000:0.0:1784045265.563593:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873785088 00000100:00100000:0.0:1784045265.563674:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784045265.563684:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873785984:12345-0@lo:400: 00000100:00100000:0.0:1784045265.563745:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873785984:12345-0@lo:400: Request processed in 62us (6904us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045265.563752:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784045265.563769:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784045265.563775:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873785088:12345-0@lo:400: 00000100:00100000:0.0:1784045265.563809:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873785088:12345-0@lo:400: Request processed in 34us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045265.563814:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1784045265.563846:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1784045265.564052:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820d880 x1870706873785984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045265.564065:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873785984:0@lo:400: 00000100:00100000:2.0:1784045265.564108:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045265.564140:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873785856:0@lo:400: 00000100:00100000:2.0:1784045265.564169:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045265.564401:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873784832:0@lo:41: 00000100:00100000:2.0:1784045265.564430:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873785344 00000100:00100000:2.0:1784045265.564434:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873785344 00000100:00100000:2.0:1784045265.564488:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873785856 00000100:00100000:2.0:1784045265.564491:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873785856 00000100:00100000:2.0:1784045265.564505:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784045265.564512:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873785344:12345-0@lo:400: 00000100:00100000:2.0:1784045265.564551:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873785344:12345-0@lo:400: Request processed in 39us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045265.564558:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784045265.564570:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784045265.564576:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873785856:12345-0@lo:400: 00000100:00100000:2.0:1784045265.564604:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873785856:12345-0@lo:400: Request processed in 29us (435us total) trans 0 rc 0/0 00000100:00080000:0.0:1784045265.564770:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045265.564827:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784045265.564857:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873785344:0@lo:400: 00000100:00100000:2.0:1784045265.564879:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873785856:0@lo:400: 00000100:00100000:3.0:1784045265.566659:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873785728 00000100:00100000:0.0:1784045265.566729:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873786240 00000100:00100000:0.0:1784045265.566741:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873786240 00000100:00100000:3.0:1784045265.566756:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873785728 00000100:00100000:0.0:1784045265.566808:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784045265.566817:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873786240:12345-0@lo:400: 00000100:00100000:2.0:1784045265.566878:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045265.566912:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873785600 00000100:00100000:3.0:1784045265.566917:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873785600 00000100:00100000:2.0:1784045265.566948:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873786112:0@lo:400: 00000100:00100000:2.0:1784045265.566993:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045265.567029:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873785088:0@lo:400: 00000100:00100000:2.0:1784045265.567067:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873786112 00000100:00100000:2.0:1784045265.567070:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873786112 00000100:00100000:2.0:1784045265.567090:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784045265.567096:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873785728:12345-0@lo:400: 00000100:00100000:2.0:1784045265.567129:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873785728:12345-0@lo:400: Request processed in 33us (10162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045265.567135:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784045265.567151:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784045265.567157:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873786112:12345-0@lo:400: 00000100:00100000:3.0:1784045265.567185:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784045265.567197:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873785600:12345-0@lo:400: 00000100:00100000:2.0:1784045265.567205:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873786112:12345-0@lo:400: Request processed in 47us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045265.567212:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784045265.567261:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873785600:12345-0@lo:400: Request processed in 66us (390us total) trans 0 rc 0/0 00010000:00080000:2.0:1784045265.567264:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820e680 x1870706873785600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045265.567273:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784045265.567284:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873785600:0@lo:400: 00010000:00080000:2.0:1784045265.567298:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820e300 x1870706873786112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045265.567305:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873786112:0@lo:400: 00000100:00080000:2.0:1784045265.567334:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045265.567338:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045265.567747:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873785216:0@lo:400: 00010000:00080000:1.0:1784045265.567760:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820ed80 x1870706873785728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045265.567768:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873785728:0@lo:400: 00000100:00100000:0.0:1784045265.567853:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873786240:12345-0@lo:400: Request processed in 1038us (10792us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045265.567860:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1784045265.568058:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf508e00 x1870706873786240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045265.568067:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf508e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873786240:0@lo:400: 00010000:00010000:3.0:1784045265.879282:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045266.068132:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873786368:0@lo:13: 00000100:00100000:0.0:1784045266.068203:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045266.068280:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873786368 00000100:00100000:3.0:1784045266.068288:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873786368 00000100:00100000:3.0:1784045266.068345:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784045266.068353:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873786368:12345-0@lo:13: 00002000:00000024:3.0:1784045266.068383:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045266.068429:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873786368:12345-0@lo:13: Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045266.068437:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784045266.068487:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873786496:0@lo:13: 00000100:00100000:3.0:1784045266.068517:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1784045266.068573:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf508380 x1870706873786368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045266.068839:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873786496 00000100:00100000:0.0:1784045266.068845:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873786496 00000100:00100000:0.0:1784045266.068874:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784045266.068891:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873786496:12345-0@lo:13: 00002000:00000024:0.0:1784045266.068905:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045266.068943:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873786496:12345-0@lo:13: Request processed in 63us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045266.068950:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1784045266.068985:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d4700 x1870706873786496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045266.069000:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873786496:0@lo:13: 00000100:00100000:2.0:1784045266.073843:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873786368:0@lo:13: 00000100:00100000:0.0:1784045266.111512:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045266.111555:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045266.111587:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045266.111608:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045266.111626:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045266.111698:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863248640 00000100:00100000:1.0:1784045266.111706:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863248640 00000100:00100000:1.0:1784045266.111763:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863248768 00000100:00100000:1.0:1784045266.111766:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863248768 00000100:00100000:1.0:1784045266.111795:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:1.0:1784045266.111803:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863248640:12345-192.168.203.44@tcp:400: 00000100:00100000:1.0:1784045266.111878:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863248640:12345-192.168.203.44@tcp:400: Request processed in 75us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.111885:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:1.0:1784045266.111905:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:1.0:1784045266.111910:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863248768:12345-192.168.203.44@tcp:400: 00000100:00100000:1.0:1784045266.111940:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863248768:12345-192.168.203.44@tcp:400: Request processed in 30us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.111946:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:3.0:1784045266.112301:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863248256 00000100:00100000:3.0:1784045266.112306:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863248256 00000100:00100000:3.0:1784045266.112343:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 197 00000100:00100000:3.0:1784045266.112349:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+8:2394:x1870706863248256:12345-192.168.203.44@tcp:400: 00000100:00100000:3.0:1784045266.112387:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+8:2394:x1870706863248256:12345-192.168.203.44@tcp:400: Request processed in 37us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045266.112393:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 197 00000100:00100000:2.0:1784045266.112809:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863248384 00000100:00100000:2.0:1784045266.112874:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863248384 00000100:00100000:2.0:1784045266.112915:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863248512 00000100:00100000:2.0:1784045266.112918:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863248512 00000100:00100000:0.0:1784045266.113013:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:0.0:1784045266.113023:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863248384:12345-192.168.203.44@tcp:400: 00000100:00100000:0.0:1784045266.113065:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863248384:12345-192.168.203.44@tcp:400: Request processed in 43us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045266.113072:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:2.0:1784045266.114114:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:2.0:1784045266.114125:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863248512:12345-192.168.203.44@tcp:400: 00000100:00100000:2.0:1784045266.115039:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863248512:12345-192.168.203.44@tcp:400: Request processed in 911us (3423us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.115049:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00080000:0.0:1784045266.115158:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784045266.115164:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045266.115167:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045266.115169:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1784045266.515589:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784045266.515597:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939b82301000 from 48 10000000:01000000:2.0:1784045266.515603:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784045266.515654:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045266.515665:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045266.515675:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045266.515699:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873786624:0@lo:101: 00000100:00100000:2.0:1784045266.515768:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045266.515897:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a606c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045266.516841:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873786624 00000100:00100000:1.0:1784045266.516850:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873786624 00000100:00100000:1.0:1784045266.516914:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1784045266.517043:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+15:6493:x1870706873786624:12345-0@lo:101: 00010000:00010000:1.0:1784045266.517067:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045266.517086:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106fe00/0x5475624df454c5e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c5e2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.517112:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106fe00/0x5475624df454c5e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c5e2 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.517122:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106fe00/0x5475624df454c5e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c5e2 expref: 16 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.517130:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106fe00, rc 0) 00000100:00100000:1.0:1784045266.517201:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873786624:12345-0@lo:101: Request processed in 278us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.517237:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1784045266.517699:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873786624:0@lo:101: 00010000:00010000:2.0:1784045266.517718:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045266.517736:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045266.517806:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873786752:0@lo:501: 00000100:00100000:2.0:1784045266.517842:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045266.517878:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a606c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045266.518008:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873786752 00000100:00100000:1.0:1784045266.518013:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873786752 00000100:00100000:1.0:1784045266.518096:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784045266.518106:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873786752:12345-0@lo:501: 00000100:00100000:1.0:1784045266.518247:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873786752:12345-0@lo:501: Request processed in 142us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.518254:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1784045266.518322:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873786752:0@lo:501: 00000100:00100000:2.0:1784045266.518365:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873786880:0@lo:503: 00000100:00100000:2.0:1784045266.518407:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045266.519144:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a606c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045266.519791:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873786880 00000100:00100000:3.0:1784045266.519811:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873786880 00000100:00100000:3.0:1784045266.519848:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1784045266.519856:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873786880:12345-0@lo:503: 00000100:00100000:3.0:1784045266.522124:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:6493:x1870706873786880:12345-0@lo:503: Request processed in 2260us (3708us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045266.522138:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1784045266.524421:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873786880:0@lo:503: 00000100:00100000:2.0:1784045266.527150:0:10328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10328:1870706873787008:0@lo:502: 00000100:00100000:2.0:1784045266.527239:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045266.527324:0:10328:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a60540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045266.527368:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873787008 00000100:00100000:1.0:1784045266.527375:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873787008 00000100:00100000:1.0:1784045266.527468:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1784045266.527478:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:10328:x1870706873787008:12345-0@lo:502: 00000100:00100000:1.0:1784045266.527626:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:10328:x1870706873787008:12345-0@lo:502: Request processed in 150us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.527634:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784045266.527735:0:10328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10328:1870706873787008:0@lo:502: 00000100:00100000:2.0:1784045266.527778:0:10328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10328:1870706873787136:0@lo:502: 00000100:00100000:2.0:1784045266.527821:0:10328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045266.528173:0:10328:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a60540 going to sleep for 11 seconds 00000100:00100000:0.0:1784045266.532482:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873787136 00000100:00100000:0.0:1784045266.532497:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873787136 00000100:00100000:0.0:1784045266.532562:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1784045266.532572:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:10328:x1870706873787136:12345-0@lo:502: 00000100:00100000:0.0:1784045266.532765:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+16:10328:x1870706873787136:12345-0@lo:502: Request processed in 193us (4942us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.532842:0:10328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10328:1870706873787136:0@lo:502: 00000040:00080000:2.0:1784045266.532883:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1784045266.532999:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1784045266.533021:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784045266.533032:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045266.533043:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045266.533118:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784045266.533121:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1784045266.533124:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784045266.533155:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045266.533163:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045266.533173:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045266.533191:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83566d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873787264:0@lo:101: 00000100:00100000:3.0:1784045266.533246:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045266.533323:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8546f780 going to sleep for 11 seconds 00000100:00100000:1.0:1784045266.533360:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873787264 00000100:00100000:1.0:1784045266.533366:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873787264 00000100:00100000:1.0:1784045266.533435:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1784045266.533465:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873787264:12345-0@lo:101: 00010000:00010000:1.0:1784045266.533475:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045266.533488:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106f000/0x5475624df454c5f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c5f0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.533510:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106f000/0x5475624df454c5f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c5f0 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.533520:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106f000/0x5475624df454c5f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c5f0 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.533536:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106f000, rc 0) 00000100:00100000:1.0:1784045266.533568:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873787264:12345-0@lo:101: Request processed in 126us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.533574:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784045266.533868:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83566d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873787264:0@lo:101: 00010000:00010000:2.0:1784045266.533885:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045266.533906:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045266.533978:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873787392:0@lo:501: 00000100:00100000:2.0:1784045266.534010:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045266.534040:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a60540 going to sleep for 11 seconds 00000100:00100000:3.0:1784045266.534076:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873787392 00000100:00100000:3.0:1784045266.534087:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873787392 00000100:00100000:3.0:1784045266.534117:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1784045266.534124:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873787392:12345-0@lo:501: 00000100:00100000:3.0:1784045266.534337:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873787392:12345-0@lo:501: Request processed in 213us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045266.534344:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1784045266.534426:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873787392:0@lo:501: 00000100:00100000:2.0:1784045266.534491:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873787520:0@lo:503: 00000100:00100000:2.0:1784045266.534531:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045266.534560:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a60540 going to sleep for 11 seconds 00000100:00100000:0.0:1784045266.534610:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1784045266.534631:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873787520 00000100:00100000:3.0:1784045266.534636:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873787520 00000100:00100000:3.0:1784045266.534754:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1784045266.534767:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873787520:12345-0@lo:503: 00000100:00100000:2.0:1784045266.535142:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873787520:0@lo:503: 00000100:00100000:3.0:1784045266.535205:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873787520:12345-0@lo:503: Request processed in 283us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.537477:0:10329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10329:1870706873787648:0@lo:502: 00000100:00100000:2.0:1784045266.537555:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045266.537615:0:10329:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a60480 going to sleep for 11 seconds 00000100:00100000:0.0:1784045266.537925:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873787648 00000100:00100000:0.0:1784045266.537932:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873787648 00000100:00100000:3.0:1784045266.542475:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1784045266.543497:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1784045266.543520:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:10329:x1870706873787648:12345-0@lo:502: 00000100:00100000:2.0:1784045266.543702:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:10329:x1870706873787648:12345-0@lo:502: Request processed in 188us (6145us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.543709:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1784045266.544070:0:10329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10329:1870706873787648:0@lo:502: 00000020:01000000:0.0:1784045266.544107:0:10329:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045266.544117:0:10329:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045266.544120:0:10329:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784045266.544125:0:10329:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784045266.544167:0:10329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10329:1870706873787776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045266.544230:0:10329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045266.548425:0:10329:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045266.548933:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873787776 00000100:00100000:1.0:1784045266.548942:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873787776 00000100:00100000:1.0:1784045266.548991:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1784045266.549000:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:10329:x1870706873787776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045266.549166:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:10329:x1870706873787776:12345-0@lo:502:llog_process_th.0 Request processed in 167us (4946us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.549174:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1784045266.549285:0:10329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10329:1870706873787776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784045266.549324:0:10329:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045266.549331:0:10329:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045266.549333:0:10329:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784045266.549337:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1784045266.549764:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1784045266.549796:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784045266.549806:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.549815:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045266.549824:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784045266.549826:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939cc10ba000 from 48 10000000:01000000:1.0:1784045266.549828:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784045266.549855:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.549862:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.549882:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045266.549903:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6926a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873787904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.549939:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.549998:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb687dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.550346:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873787904 00000100:00100000:2.0:1784045266.550353:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873787904 00000100:00100000:0.0:1784045266.550406:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1784045266.550473:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+17:6493:x1870706873787904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045266.550484:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045266.550497:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106f600/0x5475624df454c605 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c5fe expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.550529:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106f600/0x5475624df454c605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c5fe expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.550539:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106f600/0x5475624df454c605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c5fe expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.550547:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106f600, rc 0) 00000100:00100000:1.0:1784045266.550586:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873787904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.550592:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1784045266.550771:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6926a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873787904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045266.550786:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.550795:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045266.550848:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873788032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.550877:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045266.550896:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045266.550944:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873788032 00000100:00100000:1.0:1784045266.550948:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873788032 00000100:00100000:1.0:1784045266.550966:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1784045266.550972:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873788032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.551081:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873788032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.551096:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1784045266.554312:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873788032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.554375:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873788160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.554473:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045266.554516:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045266.554585:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873788160 00000100:00100000:1.0:1784045266.554592:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873788160 00000100:00100000:1.0:1784045266.554690:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1784045266.554698:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873788160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.554815:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873788160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.554822:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1784045266.555203:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873788160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045266.556055:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83567480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10330:1870706873788288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045266.556116:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045266.556262:0:10330:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8546f780 going to sleep for 11 seconds 00000100:00100000:0.0:1784045266.557719:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873788288 00000100:00100000:0.0:1784045266.557732:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873788288 00000100:00100000:1.0:1784045266.557953:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1784045266.557963:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:10330:x1870706873788288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045266.558194:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:10330:x1870706873788288:12345-0@lo:502:llog_process_th.0 Request processed in 232us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.558202:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1784045266.558329:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83567480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10330:1870706873788288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045266.558391:0:10330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10330:1870706873788416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045266.559333:0:10330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045266.559417:0:10330:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a60480 going to sleep for 11 seconds 00000100:00100000:0.0:1784045266.561708:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873788416 00000100:00100000:0.0:1784045266.561722:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873788416 00000100:00100000:2.0:1784045266.561962:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1784045266.561973:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:10330:x1870706873788416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045266.562168:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:10330:x1870706873788416:12345-0@lo:502:llog_process_th.0 Request processed in 196us (3725us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.562176:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1784045266.562273:0:10330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10330:1870706873788416:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784045266.562308:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784045266.562851:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1784045266.562871:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784045266.562882:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.562904:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045266.562915:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784045266.562917:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1784045266.562920:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784045266.562962:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.562971:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.562981:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045266.563005:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873788544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.563047:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045266.563995:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045266.564080:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873788544 00000100:00100000:1.0:1784045266.564086:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873788544 00000100:00100000:1.0:1784045266.564128:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1784045266.564136:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+18:6493:x1870706873788544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045266.564148:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045266.564164:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106f400/0x5475624df454c613 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c60c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.564189:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106f400/0x5475624df454c613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c60c expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.564199:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106f400/0x5475624df454c613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c60c expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.564232:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106f400, rc 0) 00000100:00100000:1.0:1784045266.564285:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873788544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.564291:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1784045266.564380:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873788544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045266.564398:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.564408:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045266.564486:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873788672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.564579:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045266.564681:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833dd540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.564728:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873788672 00000100:00100000:2.0:1784045266.564732:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873788672 00000100:00100000:2.0:1784045266.564756:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1784045266.564764:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873788672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045266.564903:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873788672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.564910:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1784045266.565007:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873788672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.565035:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873788800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.565076:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045266.565103:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833dd540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.565139:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873788800 00000100:00100000:2.0:1784045266.565142:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873788800 00000100:00100000:2.0:1784045266.565170:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1784045266.565176:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873788800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045266.565267:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873788800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.565274:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1784045266.565374:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873788800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.565872:0:10331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10331:1870706873788928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045266.565910:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045266.565935:0:10331:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833dd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.566008:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873788928 00000100:00100000:2.0:1784045266.566013:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873788928 00000100:00100000:2.0:1784045266.566034:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1784045266.566040:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:10331:x1870706873788928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045266.566112:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:10331:x1870706873788928:12345-0@lo:502:llog_process_th.0 Request processed in 72us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.566122:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1784045266.566194:0:10331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10331:1870706873788928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784045266.566213:0:10331:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045266.566231:0:10331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045266.566234:0:10331:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784045266.566238:0:10331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784045266.566255:0:10331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10331:1870706873789056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045266.566282:0:10331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045266.566300:0:10331:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833dd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045266.566340:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873789056 00000100:00100000:1.0:1784045266.566344:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873789056 00000100:00100000:1.0:1784045266.566361:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1784045266.566366:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:10331:x1870706873789056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045266.566429:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:10331:x1870706873789056:12345-0@lo:502:llog_process_th.0 Request processed in 63us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.566435:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1784045266.566723:0:10331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10331:1870706873789056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784045266.566740:0:10331:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045266.566743:0:10331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045266.566745:0:10331:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784045266.566748:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1784045266.567046:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1784045266.567065:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784045266.567074:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.567084:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045266.567094:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784045266.567097:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939c9157c000 from 48 10000000:01000000:1.0:1784045266.567100:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784045266.567124:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.567132:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.567151:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045266.567174:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873789184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.567206:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.567243:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045266.568698:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873789184 00000100:00100000:0.0:1784045266.568709:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873789184 00000100:00100000:0.0:1784045266.568769:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1784045266.568777:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:6493:x1870706873789184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045266.568803:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045266.568820:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915aa200/0x5475624df454c621 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c61a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.568844:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915aa200/0x5475624df454c621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c61a expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.568855:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915aa200/0x5475624df454c621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c61a expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.568864:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aa200, rc 0) 00000100:00100000:0.0:1784045266.568921:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873789184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045266.568927:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784045266.569673:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873789184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045266.569695:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.569707:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045266.569774:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873789312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.569810:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.569841:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045266.570203:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873789312 00000100:00100000:0.0:1784045266.570209:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873789312 00000100:00100000:0.0:1784045266.570314:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1784045266.570323:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873789312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.570477:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873789312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045266.570486:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1784045266.570804:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873789312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.570857:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873789440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.570896:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.578855:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.579424:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873789440 00000100:00100000:2.0:1784045266.579434:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873789440 00000100:00100000:2.0:1784045266.579509:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1784045266.579519:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873789440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045266.579738:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873789440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (8839us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.579745:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1784045266.580238:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873789440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.585430:0:10332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10332:1870706873789568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045266.585752:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045266.585839:0:10332:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833dd000 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.586137:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873789568 00000100:00100000:2.0:1784045266.586145:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873789568 00000100:00100000:2.0:1784045266.586236:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1784045266.586246:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:10332:x1870706873789568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045266.586400:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:10332:x1870706873789568:12345-0@lo:502:llog_process_th.0 Request processed in 155us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.586407:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1784045266.586523:0:10332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf50ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10332:1870706873789568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045266.586581:0:10332:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10332:1870706873789696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045266.586637:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.586946:0:10332:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045266.587011:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873789696 00000100:00100000:0.0:1784045266.587016:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873789696 00000100:00100000:0.0:1784045266.587041:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1784045266.587047:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:10332:x1870706873789696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045266.587181:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:10332:x1870706873789696:12345-0@lo:502:llog_process_th.0 Request processed in 133us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045266.587187:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784045266.587287:0:10332:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10332:1870706873789696:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784045266.587310:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1784045266.589265:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1784045266.589297:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784045266.589308:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045266.589321:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045266.589331:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1784045266.589333:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1784045266.589337:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784045266.589371:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045266.589391:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045266.589401:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045266.589424:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873789824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784045266.589581:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045266.589680:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fcd9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045266.589830:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873789824 00000100:00100000:0.0:1784045266.589837:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873789824 00000100:00100000:0.0:1784045266.589875:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1784045266.589883:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873789824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045266.589896:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045266.589907:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915ab800/0x5475624df454c62f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c628 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.589931:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915ab800/0x5475624df454c62f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c628 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.589942:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915ab800/0x5475624df454c62f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c628 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.589951:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915ab800, rc 0) 00000100:00100000:0.0:1784045266.590001:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873789824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045266.590008:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1784045266.590079:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873789824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045266.590094:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045266.590103:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045266.590156:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873789952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045266.590192:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045266.590230:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9804b480 going to sleep for 11 seconds 00000100:00100000:0.0:1784045266.590267:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873789952 00000100:00100000:0.0:1784045266.590271:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873789952 00000100:00100000:0.0:1784045266.590299:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1784045266.590306:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873789952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.590412:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873789952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045266.590427:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784045266.590526:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873789952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045266.590551:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873790080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045266.590586:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045266.590760:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873790080 00000100:00100000:0.0:1784045266.590766:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873790080 00000100:00100000:0.0:1784045266.590793:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1784045266.590799:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873790080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.590869:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873790080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045266.590876:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1784045266.590940:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9804b480 going to sleep for 11 seconds 00000100:00100000:3.0:1784045266.590952:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873790080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045266.591253:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10333:1870706873790208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045266.591289:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045266.591309:0:10333:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9804bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784045266.591347:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873790208 00000100:00100000:0.0:1784045266.591351:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873790208 00000100:00100000:0.0:1784045266.591378:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1784045266.591387:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:10333:x1870706873790208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045266.591657:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:10333:x1870706873790208:12345-0@lo:502:llog_process_th.0 Request processed in 102us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045266.591667:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1784045266.591795:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10333:1870706873790208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045266.591817:0:10333:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045266.591825:0:10333:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045266.591827:0:10333:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784045266.591833:0:10333:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784045266.591850:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10333:1870706873790336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045266.591882:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045266.591908:0:10333:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8546fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045266.591942:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873790336 00000100:00100000:0.0:1784045266.591947:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873790336 00000100:00100000:0.0:1784045266.591976:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1784045266.591983:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:10333:x1870706873790336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045266.592053:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:10333:x1870706873790336:12345-0@lo:502:llog_process_th.0 Request processed in 70us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045266.592059:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1784045266.592148:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10333:1870706873790336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045266.592165:0:10333:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045266.592169:0:10333:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045266.592170:0:10333:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784045266.592174:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1784045266.592309:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1784045266.592327:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1784045266.592337:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.592351:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045266.592361:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784045266.592364:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939c9775c000 from 48 10000000:01000000:0.0:1784045266.592366:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784045266.592387:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.592394:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.592401:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045266.592413:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf50b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873790464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.592437:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045266.592539:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045266.592809:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873790464 00000100:00100000:3.0:1784045266.592814:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873790464 00000100:00100000:3.0:1784045266.593272:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784045266.593280:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873790464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045266.593293:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045266.593308:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc2171e00/0x5475624df454c63d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c636 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045266.593331:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc2171e00/0x5475624df454c63d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c636 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045266.593341:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc2171e00/0x5475624df454c63d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c636 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045266.593348:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171e00, rc 0) 00000100:00100000:3.0:1784045266.593404:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873790464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045266.593410:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1784045266.593512:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf50b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873790464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045266.593529:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.593537:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045266.593593:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873790592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.593633:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.594091:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045266.594120:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873790592 00000100:00100000:0.0:1784045266.594125:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873790592 00000100:00100000:3.0:1784045266.594188:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1784045266.594197:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873790592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045266.594334:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873790592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045266.594341:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1784045266.594401:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873790592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.594431:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873790720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.594515:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.594832:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.594891:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873790720 00000100:00100000:2.0:1784045266.594896:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873790720 00000100:00100000:2.0:1784045266.594921:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1784045266.594928:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873790720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045266.595018:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873790720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.595025:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1784045266.595171:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873790720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.595381:0:10334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10334:1870706873790848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045266.595419:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.595434:0:10334:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.595840:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873790848 00000100:00100000:2.0:1784045266.595846:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873790848 00000100:00100000:2.0:1784045266.595866:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1784045266.595871:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:10334:x1870706873790848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045266.595967:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:10334:x1870706873790848:12345-0@lo:502:llog_process_th.0 Request processed in 95us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.595974:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1784045266.596048:0:10334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10334:1870706873790848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045266.596088:0:10334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10334:1870706873790976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045266.596126:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.596146:0:10334:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.596194:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873790976 00000100:00100000:2.0:1784045266.596198:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873790976 00000100:00100000:2.0:1784045266.596213:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1784045266.596236:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:10334:x1870706873790976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045266.596384:0:10334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10334:1870706873790976:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784045266.596401:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1784045266.596470:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1784045266.596486:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784045266.596668:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.596680:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045266.596689:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784045266.596691:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1784045266.596694:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784045266.596717:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.596725:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.596734:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045266.596748:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873791104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.596775:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.596792:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.596901:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:10334:x1870706873790976:12345-0@lo:502:llog_process_th.0 Request processed in 67us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.596908:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1784045266.596936:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873791104 00000100:00100000:2.0:1784045266.596941:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873791104 00000100:00100000:2.0:1784045266.596958:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1784045266.596963:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873791104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045266.596971:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045266.596983:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81987000/0x5475624df454c64b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c644 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045266.597003:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987000/0x5475624df454c64b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c644 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045266.597013:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81987000/0x5475624df454c64b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c644 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045266.597021:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987000, rc 0) 00000100:00100000:2.0:1784045266.597060:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873791104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.597066:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1784045266.597131:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873791104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045266.597155:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.597163:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045266.597207:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873791232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.597243:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.597262:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.597386:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873791232 00000100:00100000:2.0:1784045266.597391:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873791232 00000100:00100000:2.0:1784045266.597409:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1784045266.597415:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873791232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045266.597836:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873791232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 420us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.597850:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1784045266.598196:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873791232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.598241:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873791360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.598282:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.598312:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045266.598325:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873791360 00000100:00100000:1.0:1784045266.598328:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873791360 00000100:00100000:1.0:1784045266.598349:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784045266.598355:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873791360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.598438:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873791360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.598463:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1784045266.598824:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873791360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045266.599200:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6924700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10335:1870706873791488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045266.599250:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.599280:0:10335:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b000 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.599386:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873791488 00000100:00100000:2.0:1784045266.599391:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873791488 00000100:00100000:2.0:1784045266.599424:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1784045266.599431:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:10335:x1870706873791488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045266.599863:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:10335:x1870706873791488:12345-0@lo:502:llog_process_th.0 Request processed in 431us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.599870:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1784045266.600017:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6924700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10335:1870706873791488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784045266.600043:0:10335:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045266.600057:0:10335:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045266.600060:0:10335:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784045266.600065:0:10335:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784045266.600088:0:10335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6924700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10335:1870706873791616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045266.600120:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045266.600185:0:10335:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c982a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.600215:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873791616 00000100:00100000:2.0:1784045266.600228:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873791616 00000100:00100000:2.0:1784045266.600287:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784045266.600293:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:10335:x1870706873791616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045266.600375:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:10335:x1870706873791616:12345-0@lo:502:llog_process_th.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045266.600381:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1784045266.600435:0:10335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6924700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10335:1870706873791616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045266.600489:0:10335:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045266.600494:0:10335:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045266.600495:0:10335:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784045266.600499:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1784045266.600894:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1784045266.600914:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784045266.600923:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.600934:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045266.600955:0:6493:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784045266.600957:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff939c901d3380 from 1 10000000:01000000:0.0:1784045266.600959:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784045266.600983:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915ab000/0x5475624df454c652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.600991:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c915ab000/0x5475624df454c652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.600998:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c915ab000/0x5475624df454c652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045266.601011:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf509880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873791744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.601042:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045266.601215:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784045266.601277:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873791744 00000100:00100000:1.0:1784045266.601281:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873791744 00000100:00100000:1.0:1784045266.601314:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1784045266.601322:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873791744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045266.601332:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045266.601345:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106fa00/0x5475624df454c659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c652 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.601364:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106fa00/0x5475624df454c659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c652 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.601373:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106fa00/0x5475624df454c659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c652 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045266.601381:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106fa00, rc 0) 00000100:00100000:1.0:1784045266.601421:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873791744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045266.601427:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1784045266.601731:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf509880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873791744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045266.601745:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c915ab000/0x5475624df454c652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c659 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.601753:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c915ab000/0x5475624df454c652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c659 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045266.601804:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf509880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873791872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045266.601830:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045266.601855:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784045266.601896:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873791872 00000100:00100000:2.0:1784045266.601901:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873791872 00000100:00100000:2.0:1784045266.601919:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1784045266.601926:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873791872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045266.602002:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873791872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (171us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045266.602008:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1784045266.602076:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf509880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873791872:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1784045266.602099:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784045266.602113:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915ab000/0x5475624df454c652 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c659 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045266.602120:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c915ab000/0x5475624df454c652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c659 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045266.899661:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045267.923728:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045268.031740:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045268.031853:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863248896 00000100:00100000:1.0:1784045268.031869:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863248896 00000100:00100000:1.0:1784045268.031940:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 240 00000100:00100000:1.0:1784045268.031950:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+8:6167:x1870706863248896:12345-192.168.203.44@tcp:101: 00010000:00010000:1.0:1784045268.031967:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045268.031999:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106f200/0x5475624df454c660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73edc0 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045268.032026:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106f200/0x5475624df454c660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edc0 expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045268.032037:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106f200/0x5475624df454c660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edc0 expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045268.032046:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106f200, rc 0) 00000100:00100000:1.0:1784045268.032184:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6167:x1870706863248896:12345-192.168.203.44@tcp:101: Request processed in 236us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045268.032192:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 240 00000100:00100000:3.0:1784045268.038768:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045268.042043:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863249024 00000100:00100000:0.0:1784045268.042066:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863249024 00000100:00100000:0.0:1784045268.042313:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 241 00000100:00100000:0.0:1784045268.042328:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6167:x1870706863249024:12345-192.168.203.44@tcp:501: 00000100:00100000:0.0:1784045268.043758:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6167:x1870706863249024:12345-192.168.203.44@tcp:501: Request processed in 1424us (4995us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045268.043771:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 241 00000100:00100000:3.0:1784045268.050837:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045268.051002:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863249152 00000100:00100000:1.0:1784045268.051017:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863249152 00000100:00100000:1.0:1784045268.051099:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 242 00000100:00100000:1.0:1784045268.051111:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6167:x1870706863249152:12345-192.168.203.44@tcp:503: 00000100:00100000:1.0:1784045268.051554:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6167:x1870706863249152:12345-192.168.203.44@tcp:503: Request processed in 444us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045268.051563:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 242 00000100:00100000:3.0:1784045268.077328:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045268.078112:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863249280 00000100:00100000:0.0:1784045268.078127:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863249280 00000100:00100000:0.0:1784045268.078218:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 243 00000100:00100000:0.0:1784045268.078232:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6651:x1870706863249280:12345-192.168.203.44@tcp:502: 00000100:00100000:0.0:1784045268.078496:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6651:x1870706863249280:12345-192.168.203.44@tcp:502: Request processed in 214us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045268.078506:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 243 00000100:00100000:3.0:1784045268.083841:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045268.085159:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863249408 00000100:00100000:2.0:1784045268.085186:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863249408 00000100:00100000:2.0:1784045268.085273:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 244 00000100:00100000:2.0:1784045268.085523:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6651:x1870706863249408:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045268.085680:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6651:x1870706863249408:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 160us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045268.085688:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 244 00000100:00100000:3.0:1784045268.093435:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045268.093578:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863249536 00000100:00100000:1.0:1784045268.093594:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863249536 00000100:00100000:1.0:1784045268.093695:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 245 00000100:00100000:1.0:1784045268.093708:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6167:x1870706863249536:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045268.093728:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045268.093752:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106ec00/0x5475624df454c667 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73edc7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045268.093813:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106ec00/0x5475624df454c667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edc7 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045268.093827:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106ec00/0x5475624df454c667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edc7 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045268.093838:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106ec00, rc 0) 00000100:00100000:1.0:1784045268.093924:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6167:x1870706863249536:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 219us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045268.093932:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 245 00000100:00100000:3.0:1784045268.098985:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045268.099096:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863249664 00000100:00100000:0.0:1784045268.099107:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863249664 00000100:00100000:0.0:1784045268.099170:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 246 00000100:00100000:0.0:1784045268.099180:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6167:x1870706863249664:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045268.099671:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6167:x1870706863249664:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 491us (694us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784045268.099698:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 246 00000100:00100000:1.0:1784045268.627770:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045268.627796:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873792000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045268.627865:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045268.628103:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873792000 00000100:00100000:2.0:1784045268.628112:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873792000 00000100:00100000:2.0:1784045268.628176:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045268.628186:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873792000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045268.628226:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045268.628272:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873792000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045268.628279:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1784045268.628339:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784045268.628369:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d5180 x1870706873792000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045268.628386:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873792000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045268.628690:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873792128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045268.628717:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045268.628783:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873792128 00000100:00100000:3.0:1784045268.628787:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873792128 00000100:00100000:3.0:1784045268.628823:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784045268.628829:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873792128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784045268.628840:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045268.628872:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873792128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045268.628878:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1784045268.628898:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6926d80 x1870706873792128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784045268.628979:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045268.629014:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873792128:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784045268.948486:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045269.141302:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045269.141325:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873792256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045269.141398:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045269.141488:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873792256 00000100:00100000:2.0:1784045269.141495:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873792256 00000100:00100000:2.0:1784045269.141540:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784045269.141549:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873792256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784045269.141581:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784045269.141640:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873792256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045269.141658:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784045269.141702:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873792256:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1784045269.391367:0:10372:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc745c2760 20000000:00000080:3.0:1784045269.391383:0:10372:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939b834db400 uarg=0000000000000000 20000000:01000000:3.0:1784045269.391423:0:10372:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784045269.391428:0:10372:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784045269.391433:0:10372:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1784045269.392409:0:10373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1784045269.392735:0:10372:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1784045269.398778:0:10372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1784045269.398817:0:10372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1784045269.398834:0:10372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1784045269.398849:0:10372:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784045269.398885:0:10372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.398905:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c915aaa00/0x5475624df454c30a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c303 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.398929:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c915aae00/0x5475624df454c318 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c311 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.398936:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc2171c00/0x5475624df454c36c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c365 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.398943:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc106ea00/0x5475624df454c492 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c48b expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.398953:0:10372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc106e800/0x5475624df454c5aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ed88 expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.398961:0:10372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.399006:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc106e800/0x5475624df454c5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed88 expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.399021:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939cc106e800/0x5475624df454c5aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed88 expref: 9 pid: 6489 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045269.399039:0:10372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6927480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1870706873792384:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045269.399150:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc106ea00/0x5475624df454c492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c48b expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.399160:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc106ea00/0x5475624df454c492 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c48b expref: 23 pid: 6489 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045269.399170:0:10372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1870706873792512:0@lo:104: 00000100:00100000:1.0:1784045269.399228:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784045269.399261:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc2171c00/0x5475624df454c36c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c365 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.399270:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc2171c00/0x5475624df454c36c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c365 expref: 23 pid: 6490 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045269.399279:0:10372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6927b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1870706873792640:0@lo:104: 00000100:00100000:1.0:1784045269.399305:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045269.399342:0:6480:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784045269.399354:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873792512 00000100:00100000:1.0:1784045269.399361:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873792512 00000100:00100000:1.0:1784045269.399399:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873792640 00000100:00100000:1.0:1784045269.399402:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873792640 00000100:00100000:1.0:1784045269.399416:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784045269.399424:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:10372:x1870706873792512:12345-0@lo:104: 00010000:00010000:1.0:1784045269.399437:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c492 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.399510:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045269.399517:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:10372:x1870706873792512:12345-0@lo:104: Request processed in 93us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045269.399524:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784045269.399545:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784045269.399552:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc12b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:10372:x1870706873792640:12345-0@lo:104: 00010000:00010000:1.0:1784045269.399559:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c36c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.399588:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784045269.399599:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc12b0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:10372:x1870706873792640:12345-0@lo:104: Request processed in 48us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045269.399605:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1784045269.399878:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c915aae00/0x5475624df454c318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c311 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.399888:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c915aae00/0x5475624df454c318 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c311 expref: 23 pid: 6489 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045269.399896:0:10372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1870706873792768:0@lo:104: 00000100:00100000:1.0:1784045269.399923:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045269.399943:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873792768 00000100:00100000:1.0:1784045269.399947:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873792768 00000100:00100000:1.0:1784045269.399964:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784045269.399970:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6926d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:10372:x1870706873792768:12345-0@lo:104: 00010000:00010000:1.0:1784045269.399979:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c318 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.400010:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784045269.400015:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6926d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:10372:x1870706873792768:12345-0@lo:104: Request processed in 45us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045269.400020:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1784045269.400048:0:10372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c915aaa00/0x5475624df454c30a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c303 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.400057:0:10372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939c915aaa00/0x5475624df454c30a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c303 expref: 23 pid: 6490 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045269.400067:0:10372:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6924700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1870706873792896:0@lo:104: 00000100:00100000:1.0:1784045269.400096:0:10372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045269.400114:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873792896 00000100:00100000:1.0:1784045269.400117:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873792896 00000100:00100000:1.0:1784045269.400133:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784045269.400139:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:10372:x1870706873792896:12345-0@lo:104: 00010000:00010000:1.0:1784045269.400146:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c30a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.400170:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1784045269.400175:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:10372:x1870706873792896:12345-0@lo:104: Request processed in 37us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045269.400180:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784045269.400211:0:10372:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fd08e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784045269.400233:0:10372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1870706873792512:0@lo:104: 00000100:00100000:1.0:1784045269.400241:0:10372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6927b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1870706873792640:0@lo:104: 00000100:00100000:1.0:1784045269.400247:0:10372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1870706873792768:0@lo:104: 00000100:00100000:1.0:1784045269.400253:0:10372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6924700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1870706873792896:0@lo:104: 00010000:00010000:3.0:1784045269.400691:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784045269.400699:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c492 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400720:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915ab400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045269.400724:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c492 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400732:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c492 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045269.400740:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c492 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045269.400746:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784045269.400787:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c492 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400795:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045269.400817:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c492 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400825:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915ab400/0x5475624df454c48b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c492 expref: -99 pid: 9489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400841:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784045269.400844:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c36c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400849:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045269.400852:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c36c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400867:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c36c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045269.400873:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c36c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045269.400879:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784045269.400892:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c36c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400898:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045269.400914:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c36c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400920:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc2171800/0x5475624df454c365 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c36c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400930:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045269.400934:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c318 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400940:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915ab200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045269.400942:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c318 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400948:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c318 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045269.400954:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c318 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045269.400965:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784045269.400979:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c318 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400985:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045269.400991:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c318 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.400997:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915ab200/0x5475624df454c311 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c318 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.401006:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045269.401009:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c30a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.401014:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915abc00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045269.401017:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c303 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c30a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.401024:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c30a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045269.401030:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c303 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c30a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045269.401035:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784045269.401047:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c303 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c30a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.401052:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045269.401066:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c303 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c30a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.401072:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c303 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c30a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.401087:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045269.401089:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045269.401090:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045269.401098:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045269.401411:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045269.401426:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873793408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045269.401507:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045269.401544:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045269.401551:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873793024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045269.401572:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045269.401597:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873793152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045269.401618:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045269.401634:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045269.401640:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873793280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045269.401661:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045269.401790:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873793408 00000100:00100000:3.0:1784045269.401797:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873793408 00010000:00010000:3.0:1784045269.401823:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c915aaa00/0x5475624df454c30a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c303 expref: 24 pid: 6490 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045269.401841:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873793024 00000100:00100000:3.0:1784045269.401843:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873793024 00010000:00010000:3.0:1784045269.401854:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc106ea00/0x5475624df454c492 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c48b expref: 25 pid: 6489 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045269.401875:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873793152 00000100:00100000:3.0:1784045269.401879:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873793152 00010000:00010000:3.0:1784045269.401889:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc2171c00/0x5475624df454c36c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c365 expref: 26 pid: 6490 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045269.401897:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873793280 00000100:00100000:3.0:1784045269.401899:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873793280 00010000:00010000:3.0:1784045269.401907:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c915aae00/0x5475624df454c318 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c311 expref: 27 pid: 6489 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045269.401918:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784045269.401923:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+27:3625:x1870706873793408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045269.401934:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045269.401939:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c915aaa00/0x5475624df454c30a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c303 expref: 27 pid: 6490 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.401948:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c915aaa00/0x5475624df454c30a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c303 expref: 27 pid: 6490 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.401962:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915aaa00/0x5475624df454c30a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c303 expref: 27 pid: 6490 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.401975:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045269.402009:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+26:3625:x1870706873793408:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045269.402016:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784045269.402033:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784045269.402038:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83567100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+25:3625:x1870706873793024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045269.402055:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045269.402059:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc106ea00/0x5475624df454c492 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c48b expref: 25 pid: 6489 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.402068:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc106ea00/0x5475624df454c492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c48b expref: 25 pid: 6489 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.402076:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106ea00/0x5475624df454c492 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c48b expref: 25 pid: 6489 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.402084:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045269.402106:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83567100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873793024:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045269.402112:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784045269.402125:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784045269.402131:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:3623:x1870706873793152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045269.402137:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045269.402142:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc2171c00/0x5475624df454c36c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c365 expref: 23 pid: 6490 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.402149:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc2171c00/0x5475624df454c36c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c365 expref: 23 pid: 6490 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.402157:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc2171c00/0x5475624df454c36c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c365 expref: 23 pid: 6490 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.402165:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045269.402191:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:3623:x1870706873793152:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045269.402218:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784045269.402232:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784045269.402238:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:3623:x1870706873793280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045269.402245:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045269.402250:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c915aae00/0x5475624df454c318 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c311 expref: 21 pid: 6489 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.402258:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c915aae00/0x5475624df454c318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c311 expref: 21 pid: 6489 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.402267:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915aae00/0x5475624df454c318 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c311 expref: 21 pid: 6489 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045269.402275:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045269.402301:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:3623:x1870706873793280:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045269.402307:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784045269.402365:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873793280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045269.402374:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873793152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045269.402400:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873793024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045269.402409:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873793408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045269.405744:0:10372:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6927480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10372:1870706873792384:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045269.405793:0:10372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045269.417859:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045269.418022:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863249792 00000100:00100000:0.0:1784045269.418033:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863249792 00010000:00010000:0.0:1784045269.418070:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc106e800/0x5475624df454c5aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed88 expref: 10 pid: 6489 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045269.418113:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:0.0:1784045269.418122:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2394:x1870706863249792:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045269.418138:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045269.418144:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc106e800/0x5475624df454c5aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed88 expref: 10 pid: 6489 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045269.418156:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc106e800/0x5475624df454c5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed88 expref: 10 pid: 6489 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045269.418175:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106e800/0x5475624df454c5aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ed88 expref: 10 pid: 6489 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045269.418195:0:9500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045269.418214:0:9500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045269.418231:0:9500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045269.418238:0:9500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045269.418263:0:9500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045269.418271:0:9500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045269.418277:0:9500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106e600 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:0.0:1784045269.418282:0:9500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045269.418290:0:9500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045269.418312:0:9500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045269.418324:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045269.418389:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:2394:x1870706863249792:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 267us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045269.418396:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 39 00010000:00010000:1.0:1784045269.418486:0:10372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.418494:0:10372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.418500:0:10372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106e600/0x5475624df454c66e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045269.648991:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045269.649081:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863249920 00000100:00100000:1.0:1784045269.649091:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863249920 00000100:00100000:1.0:1784045269.649154:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 247 00000100:00100000:1.0:1784045269.649164:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:6167:x1870706863249920:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045269.649180:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045269.649217:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106e600/0x5475624df454c675 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73edce expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.649244:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106e600/0x5475624df454c675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edce expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.649257:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106e600/0x5475624df454c675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edce expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045269.649267:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106e600, rc 0) 00000100:00100000:1.0:1784045269.649334:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6167:x1870706863249920:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 171us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045269.649342:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 247 00000100:00100000:2.0:1784045269.660271:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045269.663347:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863250048 00000100:00100000:0.0:1784045269.663365:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863250048 00000100:00100000:0.0:1784045269.663440:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 248 00000100:00100000:0.0:1784045269.663481:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6167:x1870706863250048:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045269.663665:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6167:x1870706863250048:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 185us (3408us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045269.663674:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 248 00000100:00100000:3.0:1784045269.672882:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045269.673060:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863250176 00000100:00100000:2.0:1784045269.673075:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863250176 00000100:00100000:2.0:1784045269.673239:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 249 00000100:00100000:2.0:1784045269.673256:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6167:x1870706863250176:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045269.673649:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6167:x1870706863250176:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 397us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045269.673659:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 249 00000100:00100000:2.0:1784045269.678643:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045269.679685:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863250304 00000100:00100000:1.0:1784045269.679700:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863250304 00000100:00100000:1.0:1784045269.679778:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 250 00000100:00100000:1.0:1784045269.679788:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6688:x1870706863250304:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784045269.679966:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6688:x1870706863250304:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 178us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045269.679974:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 250 00000100:00100000:3.0:1784045269.695972:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045269.696344:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863250432 00000100:00100000:2.0:1784045269.696357:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863250432 00000100:00100000:2.0:1784045269.696426:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 251 00000100:00100000:2.0:1784045269.696438:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6688:x1870706863250432:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045269.697169:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:6688:x1870706863250432:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 726us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045269.697182:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 251 00010000:00010000:3.0:1784045269.971764:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045270.675703:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045270.675739:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873793536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045270.675835:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045270.675921:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873793536 00000100:00100000:1.0:1784045270.675931:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873793536 00000100:00100000:1.0:1784045270.675992:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784045270.676001:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873793536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045270.676047:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784045270.676117:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873793536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.676125:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784045270.676186:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873793536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045270.677511:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873793792:0@lo:400:kworker.0 00000100:00100000:0.0:1784045270.677589:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045270.677627:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873794304:0@lo:400:kworker.0 00000100:00100000:0.0:1784045270.677650:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045270.677668:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873794816:0@lo:400:kworker.0 00000100:00100000:0.0:1784045270.677688:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045270.677715:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784045270.677721:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873793664:0@lo:400:kworker.0 00000100:00100000:0.0:1784045270.677751:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045270.677941:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873794048:0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.677974:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045270.677995:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873794560:0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.678017:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045270.678040:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873795072:0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.678059:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045270.678082:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1784045270.678088:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873793920:0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.678110:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045270.678122:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873794432:0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.678142:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045270.678159:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873794944:0@lo:400:kworker.0 00000100:00100000:0.0:1784045270.678170:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873794176:0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.678179:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045270.678203:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045270.678215:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873794688:0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.678222:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873793792 00000100:00100000:0.0:1784045270.678235:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045270.678236:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873793792 00000100:00100000:0.0:1784045270.678264:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873794304 00000100:00100000:0.0:1784045270.678267:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873794304 00000100:00100000:0.0:1784045270.678298:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873794816 00000100:00100000:0.0:1784045270.678301:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873794816 00000100:00100000:0.0:1784045270.678314:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873793920 00000100:00100000:0.0:1784045270.678316:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873793920 00000100:00100000:0.0:1784045270.678326:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873794176 00000100:00100000:0.0:1784045270.678328:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873794176 00000100:00100000:0.0:1784045270.678339:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873794688 00000100:00100000:0.0:1784045270.678341:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873794688 00000100:00100000:0.0:1784045270.678358:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784045270.678366:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873793792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045270.678427:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873793792:12345-0@lo:400:kworker.0 Request processed in 61us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045270.678434:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784045270.681117:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784045270.681142:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873794304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.681257:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873794304:12345-0@lo:400:kworker.0 Request processed in 126us (3604us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.681265:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784045270.681299:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784045270.681306:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873794816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.681336:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873794816:12345-0@lo:400:kworker.0 Request processed in 31us (3647us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.681342:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784045270.681354:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784045270.681360:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873793920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.681397:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873793920:12345-0@lo:400:kworker.0 Request processed in 37us (3286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.681403:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784045270.681415:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784045270.681422:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873794176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.681464:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873794176:12345-0@lo:400:kworker.0 Request processed in 43us (3260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.681470:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784045270.681482:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784045270.681488:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873794688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.681514:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873794688:12345-0@lo:400:kworker.0 Request processed in 28us (3278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.681529:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784045270.681552:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873794048 00000100:00100000:1.0:1784045270.681561:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873794048 00000100:00100000:1.0:1784045270.681607:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784045270.681614:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873794048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.681649:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873794048:12345-0@lo:400:kworker.0 Request processed in 36us (3673us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.681654:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784045270.681683:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873794560 00000100:00100000:1.0:1784045270.681687:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873794560 00000100:00100000:1.0:1784045270.681716:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873795072 00000100:00100000:1.0:1784045270.681719:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873795072 00000100:00100000:1.0:1784045270.681733:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873794432 00000100:00100000:1.0:1784045270.681736:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873794432 00000100:00100000:1.0:1784045270.681748:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873794944 00000100:00100000:1.0:1784045270.681750:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873794944 00000100:00100000:1.0:1784045270.681764:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784045270.681769:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873794560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.681801:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873794560:12345-0@lo:400:kworker.0 Request processed in 31us (3783us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.681808:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784045270.681820:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784045270.681826:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873795072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.681854:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873795072:12345-0@lo:400:kworker.0 Request processed in 28us (3794us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.681859:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784045270.681871:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784045270.681884:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873794432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.681914:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873794432:12345-0@lo:400:kworker.0 Request processed in 31us (3770us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.681919:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784045270.681932:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784045270.681938:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873794944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.681965:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873794944:12345-0@lo:400:kworker.0 Request processed in 28us (3785us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.681971:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784045270.682027:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873793920:0@lo:400:kworker.0 00010000:00080000:1.0:1784045270.682045:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6925f80 x1870706873794432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045270.682057:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873794432:0@lo:400:kworker.0 00010000:00080000:1.0:1784045270.682068:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b6300 x1870706873794944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045270.682077:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873794944:0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.682088:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873794048:0@lo:400:kworker.0 00010000:00080000:1.0:1784045270.682098:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6924000 x1870706873794560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045270.682106:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873794560:0@lo:400:kworker.0 00010000:00080000:1.0:1784045270.682117:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b5880 x1870706873795072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045270.682126:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873795072:0@lo:400:kworker.0 00000100:00080000:1.0:1784045270.688518:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045270.688529:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045270.688534:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045270.688538:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784045270.688570:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873793664 00000100:00100000:1.0:1784045270.688583:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873793664 00000100:00100000:1.0:1784045270.688650:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1784045270.688660:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:3624:x1870706873793664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045270.688771:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:3624:x1870706873793664:12345-0@lo:400:kworker.0 Request processed in 113us (11019us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045270.688779:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1784045270.689794:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873793664:0@lo:400:kworker.0 00000100:00100000:2.0:1784045270.689818:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873794176:0@lo:400:kworker.0 00000100:00100000:2.0:1784045270.689833:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873794688:0@lo:400:kworker.0 00000100:00100000:2.0:1784045270.689848:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873793792:0@lo:400:kworker.0 00010000:00080000:2.0:1784045270.689866:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6925180 x1870706873794304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045270.689893:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873794304:0@lo:400:kworker.0 00010000:00080000:2.0:1784045270.689909:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b5c00 x1870706873794816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045270.689917:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873794816:0@lo:400:kworker.0 10000000:01000000:2.0:1784045270.873476:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784045270.873488:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939b82301000 from 4 10000000:01000000:2.0:1784045270.873494:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784045270.873557:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.873572:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.873585:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045270.873621:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873795200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.873711:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.873787:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6f780 going to sleep for 11 seconds 00000100:00100000:2.0:1784045270.873817:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873795200 00000100:00100000:2.0:1784045270.873826:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873795200 00000100:00100000:2.0:1784045270.873887:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1784045270.873897:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873795200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045270.873916:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045270.873932:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81986400/0x5475624df454c683 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c67c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.873979:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986400/0x5475624df454c683 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c67c expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.873991:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81986400/0x5475624df454c683 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c67c expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.874002:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986400, rc 0) 00000100:00100000:2.0:1784045270.874045:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873795200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045270.874053:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1784045270.874111:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873795200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045270.874129:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c683 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.874140:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c683 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045270.874226:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873795328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.874257:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.874275:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6f780 going to sleep for 11 seconds 00000100:00100000:2.0:1784045270.874288:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873795328 00000100:00100000:2.0:1784045270.874292:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873795328 00000100:00100000:2.0:1784045270.874314:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1784045270.874320:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873795328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.874478:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873795328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045270.874495:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1784045270.874527:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873795328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.874557:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873795456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.874600:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.874614:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6f780 going to sleep for 11 seconds 00000100:00100000:2.0:1784045270.874625:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873795456 00000100:00100000:2.0:1784045270.874629:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873795456 00000100:00100000:2.0:1784045270.874652:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1784045270.874658:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873795456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.874741:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873795456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045270.874748:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1784045270.874789:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873795456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.875007:0:10431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10431:1870706873795584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045270.875043:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.875060:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873795584 00000100:00100000:2.0:1784045270.875064:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873795584 00000100:00100000:2.0:1784045270.875083:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1784045270.875089:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:10431:x1870706873795584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045270.875163:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:10431:x1870706873795584:12345-0@lo:502:llog_process_th.0 Request processed in 73us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045270.875170:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1784045270.875210:0:10431:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045270.875222:0:10431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10431:1870706873795584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045270.875251:0:10431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045270.875262:0:10431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045270.875265:0:10431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784045270.875272:0:10431:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939b82301000 00000020:00000080:2.0:1784045270.875275:0:10431:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784045270.875381:0:10431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10431:1870706873795712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045270.875414:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.875434:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873795712 00000100:00100000:2.0:1784045270.875437:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873795712 00000100:00100000:2.0:1784045270.875484:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1784045270.875489:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:10431:x1870706873795712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045270.875549:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:10431:x1870706873795712:12345-0@lo:502:llog_process_th.0 Request processed in 60us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045270.875557:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1784045270.875585:0:10431:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045270.875597:0:10431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10431:1870706873795712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045270.875614:0:10431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045270.875618:0:10431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045270.875620:0:10431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784045270.875624:0:10431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784045270.875686:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784045270.875702:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784045270.875712:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c683 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.875724:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c683 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045270.875746:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784045270.875749:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939cc10ba000 from 4 10000000:01000000:2.0:1784045270.875752:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784045270.875778:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.875787:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.875796:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045270.875810:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873795840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.875836:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.875849:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045270.875859:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873795840 00000100:00100000:2.0:1784045270.875862:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873795840 00000100:00100000:2.0:1784045270.875881:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1784045270.875886:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873795840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045270.875894:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045270.875907:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81986800/0x5475624df454c691 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c68a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.875929:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986800/0x5475624df454c691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c68a expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.875940:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81986800/0x5475624df454c691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c68a expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.875959:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986800, rc 0) 00000100:00100000:2.0:1784045270.875989:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873795840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045270.875995:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1784045270.876025:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873795840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045270.876038:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c691 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.876048:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c691 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045270.876091:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873795968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.876116:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.876128:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045270.876139:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873795968 00000100:00100000:2.0:1784045270.876142:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873795968 00000100:00100000:2.0:1784045270.876162:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1784045270.876168:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873795968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.876834:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873795968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 663us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045270.876843:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1784045270.879934:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873795968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.880091:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873796096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.880199:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.880251:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045270.880317:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873796096 00000100:00100000:3.0:1784045270.880325:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873796096 00000100:00100000:3.0:1784045270.880424:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1784045270.880435:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873796096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045270.880613:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873796096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045270.880622:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1784045270.887638:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873796096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.888822:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10433:1870706873796224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045270.888920:0:10433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.888962:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873796224 00000100:00100000:2.0:1784045270.888969:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873796224 00000100:00100000:2.0:1784045270.889013:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1784045270.889022:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:10433:x1870706873796224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045270.889152:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:10433:x1870706873796224:12345-0@lo:502:llog_process_th.0 Request processed in 129us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045270.889161:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1784045270.889225:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045270.889244:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10433:1870706873796224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045270.889269:0:10433:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045270.889279:0:10433:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045270.889282:0:10433:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784045270.889288:0:10433:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939cc10ba000 00000020:00000080:2.0:1784045270.889290:0:10433:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784045270.889599:0:10433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10433:1870706873796352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045270.889636:0:10433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.889653:0:10433:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045270.890039:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873796352 00000100:00100000:3.0:1784045270.890045:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873796352 00000100:00100000:3.0:1784045270.890080:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1784045270.890087:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:10433:x1870706873796352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045270.890204:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:10433:x1870706873796352:12345-0@lo:502:llog_process_th.0 Request processed in 117us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045270.890211:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1784045270.895594:0:10433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10433:1870706873796352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045270.895660:0:10433:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045270.895671:0:10433:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045270.895674:0:10433:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784045270.895681:0:10433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784045270.898552:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784045270.898597:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784045270.898612:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c691 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.898628:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c691 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045270.898641:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784045270.898644:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939c9157c000 from 4 10000000:01000000:2.0:1784045270.898653:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784045270.898703:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.898712:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.898724:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045270.898755:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873796480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.900659:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.900712:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045270.901410:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873796480 00000100:00100000:2.0:1784045270.901422:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873796480 00000100:00100000:2.0:1784045270.901577:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784045270.901589:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873796480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045270.901611:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045270.902552:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81987200/0x5475624df454c69f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c698 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.902596:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987200/0x5475624df454c69f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c698 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.902610:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81987200/0x5475624df454c69f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c698 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.902622:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987200, rc 0) 00000100:00100000:2.0:1784045270.902709:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873796480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1121us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045270.902729:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1784045270.904926:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873796480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045270.904963:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c69f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.904979:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c69f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045270.905093:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873796608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.905163:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.905226:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045270.905249:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873796608 00000100:00100000:2.0:1784045270.905255:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873796608 00000100:00100000:2.0:1784045270.905297:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1784045270.905306:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873796608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.905951:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873796608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 642us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045270.905960:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1784045270.906028:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873796608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.906065:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873796736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.906114:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.906887:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045270.906915:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873796736 00000100:00100000:2.0:1784045270.906922:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873796736 00000100:00100000:2.0:1784045270.906972:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784045270.906988:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873796736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.907404:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873796736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045270.907411:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784045270.907880:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873796736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045270.925733:0:10436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10436:1870706873796864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045270.925857:0:10436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045270.925927:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873796864 00000100:00100000:3.0:1784045270.925935:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873796864 00000100:00100000:3.0:1784045270.925999:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1784045270.926010:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:10436:x1870706873796864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045270.926143:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:10436:x1870706873796864:12345-0@lo:502:llog_process_th.0 Request processed in 135us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045270.926151:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1784045270.926224:0:10436:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c99c2d300 going to sleep for 11 seconds 00000100:00100000:3.0:1784045270.926251:0:10436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10436:1870706873796864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045270.926284:0:10436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045270.926295:0:10436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045270.926298:0:10436:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784045270.926305:0:10436:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939c9157c000 00000020:00000080:3.0:1784045270.926308:0:10436:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784045270.930813:0:10436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10436:1870706873796992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045270.930920:0:10436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045270.930979:0:10436:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fcd90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045270.931272:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873796992 00000100:00100000:2.0:1784045270.931281:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873796992 00000100:00100000:2.0:1784045270.931356:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1784045270.931367:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:10436:x1870706873796992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045270.933635:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:10436:x1870706873796992:12345-0@lo:502:llog_process_th.0 Request processed in 2255us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045270.933651:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784045270.936362:0:10436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10436:1870706873796992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045270.936422:0:10436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045270.936432:0:10436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045270.936435:0:10436:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784045270.936440:0:10436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784045270.937520:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784045270.937620:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784045270.937637:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c69f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.937653:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c69f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045270.937666:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784045270.937669:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939c9775c000 from 4 10000000:01000000:2.0:1784045270.937672:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784045270.937720:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.937729:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.937753:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045270.937942:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873797120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784045270.938028:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045270.938512:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd6fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045270.949610:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873797120 00000100:00100000:3.0:1784045270.949633:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873797120 00000100:00100000:3.0:1784045270.949705:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1784045270.949717:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873797120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045270.949742:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045270.950035:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc2171800/0x5475624df454c6ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c6a6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045270.950088:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc2171800/0x5475624df454c6ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c6a6 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045270.950103:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc2171800/0x5475624df454c6ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c6a6 expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045270.950114:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171800, rc 0) 00000100:00100000:3.0:1784045270.950225:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873797120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 510us (12196us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045270.950234:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1784045270.950500:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873797120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045270.950525:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c6ad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045270.950536:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c6ad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045270.950878:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873797248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045270.950925:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045270.950965:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fcd96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045270.950986:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873797248 00000100:00100000:3.0:1784045270.950992:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873797248 00000100:00100000:3.0:1784045270.951031:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1784045270.951039:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873797248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045270.951179:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873797248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045270.951211:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1784045270.951252:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873797248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045270.951283:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873797376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045270.951327:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045270.952232:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fcd96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045270.952266:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873797376 00000100:00100000:3.0:1784045270.952273:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873797376 00000100:00100000:3.0:1784045270.952315:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1784045270.952323:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873797376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045270.952986:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873797376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 660us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045270.952995:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1784045270.953061:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873797376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045270.959847:0:10439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10439:1870706873797504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045270.959960:0:10439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045270.960027:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873797504 00000100:00100000:3.0:1784045270.960036:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873797504 00000100:00100000:3.0:1784045270.960096:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1784045270.960105:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:10439:x1870706873797504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045270.960261:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:10439:x1870706873797504:12345-0@lo:502:llog_process_th.0 Request processed in 156us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045270.960270:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1784045270.960339:0:10439:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fcd96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045270.961949:0:10439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10439:1870706873797504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045270.962001:0:10439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045270.962012:0:10439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045270.962015:0:10439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784045270.962021:0:10439:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939c9775c000 00000020:00000080:3.0:1784045270.962024:0:10439:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784045270.962129:0:10439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10439:1870706873797632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045270.962214:0:10439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045270.962252:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873797632 00000100:00100000:3.0:1784045270.962259:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873797632 00000100:00100000:3.0:1784045270.962309:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1784045270.962317:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:10439:x1870706873797632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045270.963322:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:10439:x1870706873797632:12345-0@lo:502:llog_process_th.0 Request processed in 999us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045270.963335:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1784045270.963603:0:10439:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fcd96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045270.963641:0:10439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83565880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:10439:1870706873797632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045270.963674:0:10439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045270.963683:0:10439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045270.963686:0:10439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784045270.963691:0:10439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784045270.966520:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784045270.966564:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784045270.966578:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c6ad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045270.966593:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c6ad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045270.998525:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045271.190042:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873797888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045271.190138:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045271.190235:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045271.190242:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873797760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045271.190269:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045271.190312:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873797888 00000100:00100000:2.0:1784045271.190322:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873797888 00000100:00100000:2.0:1784045271.190399:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873797760 00000100:00100000:2.0:1784045271.190403:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873797760 00000100:00100000:2.0:1784045271.190422:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784045271.190431:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873797888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784045271.190489:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045271.190541:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873797888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045271.190549:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784045271.190567:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784045271.190573:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873797760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045271.190583:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045271.190615:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873797760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045271.190622:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1784045271.190670:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf508000 x1870706873797760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045271.190694:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf508000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873797760:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1784045271.190706:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d5f80 x1870706873797888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045271.190716:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873797888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045271.231679:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045271.231733:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045271.231773:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045271.231796:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045271.231818:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045271.232093:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863250816 00000100:00100000:1.0:1784045271.232107:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863250816 00000100:00100000:1.0:1784045271.232182:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863250688 00000100:00100000:1.0:1784045271.232186:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863250688 00000100:00100000:1.0:1784045271.232220:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:1.0:1784045271.232242:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863250816:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045271.232345:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863250816:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 105us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045271.232354:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:1.0:1784045271.232381:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:1.0:1784045271.232388:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2397:x1870706863250688:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045271.232413:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2397:x1870706863250688:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045271.232419:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:1.0:1784045271.232440:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863251072 00000100:00100000:1.0:1784045271.232512:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863251072 00000100:00100000:1.0:1784045271.232545:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863250944 00000100:00100000:1.0:1784045271.232548:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863250944 00000100:00100000:1.0:1784045271.232571:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:1.0:1784045271.232577:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863251072:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045271.232606:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863251072:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 29us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045271.232613:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:1.0:1784045271.232627:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:1.0:1784045271.232633:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863250944:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045271.232658:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863250944:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045271.232664:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00080000:3.0:1784045271.233108:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045271.233113:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045271.233116:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784045271.233119:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045271.233182:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863250560 00000100:00100000:0.0:1784045271.233197:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863250560 00000100:00100000:0.0:1784045271.233247:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 273 00000100:00100000:0.0:1784045271.233254:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2397:x1870706863250560:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045271.233304:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2397:x1870706863250560:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 50us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045271.233311:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 273 00010000:00010000:3.0:1784045272.019812:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045273.044109:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045273.755506:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873798016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784045273.755599:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045273.755694:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873798016 00000100:00100000:1.0:1784045273.755703:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873798016 00000100:00100000:1.0:1784045273.755766:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784045273.755777:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873798016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045273.755813:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045273.755861:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873798016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045273.755869:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1784045273.755899:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784045273.755933:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b5880 x1870706873798016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045273.757621:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873798144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045273.757700:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045273.757791:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873798144 00000100:00100000:2.0:1784045273.757799:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873798144 00000100:00100000:1.0:1784045273.757884:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873798016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045273.759183:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784045273.759198:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873798144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045273.759230:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045273.759345:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873798144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045273.759353:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1784045273.764363:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d5f80 x1870706873798144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045273.764402:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873798144:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784045273.766935:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784045274.068982:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045274.263603:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045274.263638:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873798272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784045274.263751:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045274.264252:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873798272 00000100:00100000:0.0:1784045274.264263:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873798272 00000100:00100000:0.0:1784045274.264333:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784045274.264358:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873798272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045274.264403:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045274.264504:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873798272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045274.264512:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784045274.264685:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873798272:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784045275.093267:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045275.797947:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873798400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045275.798051:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045275.798133:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873798912:0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.798175:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045275.798199:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873799424:0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.798238:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045275.798262:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873799936:0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.798285:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045275.798302:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784045275.798307:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873798784:0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.798326:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045275.798342:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873799296:0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.798361:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045275.798375:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873799808:0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.798393:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045275.798439:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873798400 00000100:00100000:3.0:1784045275.798467:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873798400 00000100:00100000:3.0:1784045275.798512:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873798784 00000100:00100000:3.0:1784045275.798515:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873798784 00000100:00100000:3.0:1784045275.798529:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784045275.798539:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3624:x1870706873798400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784045275.798588:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784045275.798618:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873798912 00000100:00100000:2.0:1784045275.798623:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873798912 00000100:00100000:3.0:1784045275.798640:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3624:x1870706873798400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045275.798648:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784045275.798648:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873799296 00000100:00100000:2.0:1784045275.798650:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873799296 00000100:00100000:3.0:1784045275.798667:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784045275.798672:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873799808 00000100:00100000:2.0:1784045275.798674:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873799808 00000100:00100000:3.0:1784045275.798679:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873798784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045275.798688:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784045275.798693:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873798912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.798713:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873798784:12345-0@lo:400:kworker.0 Request processed in 34us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045275.798720:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784045275.798723:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873798912:12345-0@lo:400:kworker.0 Request processed in 31us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045275.798729:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784045275.798739:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784045275.798743:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784045275.798745:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873799296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.798748:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873799808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.798771:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873799808:12345-0@lo:400:kworker.0 Request processed in 22us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045275.798771:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873799296:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045275.798777:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784045275.798829:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873798528:0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.798867:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045275.798901:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873799040:0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.798923:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045275.798942:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873799552:0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.798964:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045275.798967:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873798528 00000100:00100000:2.0:1784045275.798971:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873798528 00000100:00100000:1.0:1784045275.798981:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873800064:0@lo:400:kworker.0 00000100:00100000:2.0:1784045275.799001:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1784045275.799003:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045275.799008:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873798528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.799021:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784045275.799027:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873798656:0@lo:400:kworker.0 00000100:00100000:2.0:1784045275.799039:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873798528:12345-0@lo:400:kworker.0 Request processed in 31us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045275.799045:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1784045275.799046:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045275.799061:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873799168:0@lo:400:kworker.0 00000100:00100000:2.0:1784045275.799075:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1784045275.799080:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045275.799082:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1784045275.799089:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873799680:0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.799108:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045275.799147:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873798528:0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.799194:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873799424 00000100:00100000:1.0:1784045275.799198:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873799424 00000100:00100000:1.0:1784045275.799226:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873799936 00000100:00100000:1.0:1784045275.799229:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873799936 00000100:00100000:2.0:1784045275.799240:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873798656 00000100:00100000:2.0:1784045275.799243:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873798656 00000100:00100000:1.0:1784045275.799243:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873799552 00000100:00100000:1.0:1784045275.799244:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873799552 00000100:00100000:1.0:1784045275.799255:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873800064 00000100:00100000:1.0:1784045275.799256:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873800064 00000100:00100000:1.0:1784045275.799269:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784045275.799279:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873799424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.799315:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873799424:12345-0@lo:400:kworker.0 Request processed in 36us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045275.799321:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784045275.799339:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784045275.799345:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873799936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.799393:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873799936:12345-0@lo:400:kworker.0 Request processed in 48us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045275.799399:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784045275.799412:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784045275.799418:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873799552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.799474:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873799552:12345-0@lo:400:kworker.0 Request processed in 56us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045275.799481:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784045275.799494:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784045275.799500:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873800064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.799540:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873800064:12345-0@lo:400:kworker.0 Request processed in 40us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045275.799552:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784045275.799739:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1784045275.799745:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873799168 00000100:00100000:1.0:1784045275.799750:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873799168 00000100:00100000:3.0:1784045275.799957:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784045275.799976:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873799680 00000100:00100000:3.0:1784045275.799979:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873799680 00000100:00100000:3.0:1784045275.799999:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784045275.800006:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873799680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.800048:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873799680:12345-0@lo:400:kworker.0 Request processed in 42us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045275.800055:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784045275.800093:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873798784:0@lo:400:kworker.0 00010000:00080000:3.0:1784045275.800110:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820ed80 x1870706873799296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045275.800122:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873799296:0@lo:400:kworker.0 00010000:00080000:3.0:1784045275.800135:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820d500 x1870706873799808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045275.800143:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873799808:0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.800154:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873798912:0@lo:400:kworker.0 00010000:00080000:3.0:1784045275.800188:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820ca80 x1870706873799424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045275.800250:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873799424:0@lo:400:kworker.0 00010000:00080000:3.0:1784045275.800267:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820ea00 x1870706873799936/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045275.800275:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873799936:0@lo:400:kworker.0 00000100:00100000:3.0:1784045275.800291:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873798400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045275.802740:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784045275.802772:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873798656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045275.803283:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873798656:12345-0@lo:400:kworker.0 Request processed in 525us (4232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045275.803293:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784045275.803742:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784045275.803758:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873799168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.803813:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873799168:12345-0@lo:400:kworker.0 Request processed in 62us (4732us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045275.803819:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784045275.803852:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873799040 00000100:00100000:1.0:1784045275.803862:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873799040 00000100:00100000:1.0:1784045275.803901:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784045275.803908:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873799040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.803946:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873799040:12345-0@lo:400:kworker.0 Request processed in 38us (5021us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045275.803952:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1784045275.803973:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045275.803980:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045275.803983:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045275.803987:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784045275.805053:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873798656:0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.805080:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873799168:0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.805094:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873799680:0@lo:400:kworker.0 00000100:00100000:1.0:1784045275.805106:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873799040:0@lo:400:kworker.0 00010000:00080000:1.0:1784045275.805121:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820e300 x1870706873799552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045275.805144:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873799552:0@lo:400:kworker.0 00010000:00080000:1.0:1784045275.805173:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820d880 x1870706873800064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045275.805183:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873800064:0@lo:400:kworker.0 00010000:00010000:3.0:1784045276.118824:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045276.307737:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873800192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045276.307850:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045276.307977:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873800192 00000100:00100000:2.0:1784045276.307987:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873800192 00000100:00100000:2.0:1784045276.308046:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784045276.308056:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873800192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784045276.308091:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045276.308139:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873800192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045276.308147:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1784045276.308207:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820d180 x1870706873800192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045276.308227:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873800192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045276.308300:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873800320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045276.308325:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045276.308361:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873800320 00000100:00100000:2.0:1784045276.308365:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873800320 00000100:00100000:2.0:1784045276.308385:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784045276.308391:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873800320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045276.308416:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045276.308473:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873800320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045276.308479:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1784045276.308504:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820d180 x1870706873800320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045276.308517:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873800320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045276.351930:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045276.351988:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045276.352023:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045276.352044:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045276.352078:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045276.352112:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863251456 00000100:00100000:0.0:1784045276.352123:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863251456 00000100:00100000:0.0:1784045276.352200:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863251328 00000100:00100000:0.0:1784045276.352219:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863251328 00000100:00100000:0.0:1784045276.352251:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 74 00000100:00100000:0.0:1784045276.352262:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863251456:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045276.352357:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863251456:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 96us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045276.352366:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 74 00000100:00100000:0.0:1784045276.352385:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 75 00000100:00100000:0.0:1784045276.352392:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863251328:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045276.352420:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863251328:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 29us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045276.352426:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 75 00000100:00100000:1.0:1784045276.352562:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863251200 00000100:00100000:1.0:1784045276.352568:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863251200 00000100:00100000:1.0:1784045276.352608:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 275 00000100:00100000:1.0:1784045276.352616:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2396:x1870706863251200:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045276.352646:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2396:x1870706863251200:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 32us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045276.352653:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 275 00000100:00100000:1.0:1784045276.352697:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863251712 00000100:00100000:1.0:1784045276.352701:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863251712 00000100:00100000:1.0:1784045276.352729:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863251584 00000100:00100000:1.0:1784045276.352733:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863251584 00000100:00100000:1.0:1784045276.352755:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:1.0:1784045276.352761:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863251712:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045276.352801:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf509500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863251712:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 40us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045276.352807:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:1.0:1784045276.352819:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:1.0:1784045276.352825:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863251584:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045276.352846:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863251584:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 21us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045276.352861:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00080000:1.0:1784045276.352884:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045276.352889:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045276.352892:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045276.352894:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:1.0:1784045276.816912:0:10673:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1784045277.157722:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045278.163608:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045278.867609:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045278.867648:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873800576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045278.867735:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045278.867817:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045278.867827:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873800448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045278.867851:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045278.867887:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873800576 00000100:00100000:2.0:1784045278.867900:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873800576 00000100:00100000:2.0:1784045278.867964:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873800448 00000100:00100000:2.0:1784045278.867967:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873800448 00000100:00100000:2.0:1784045278.867988:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784045278.867998:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873800576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045278.868037:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045278.868086:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873800576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045278.868093:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784045278.868112:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784045278.868118:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873800448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784045278.868157:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045278.868193:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873800448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045278.868199:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1784045278.868219:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784045278.868257:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b7100 x1870706873800448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045278.868278:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873800448:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1784045278.868307:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820d180 x1870706873800576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045278.868318:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873800576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784045279.190935:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045279.381610:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045279.381648:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873800704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784045279.381739:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045279.381843:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873800704 00000100:00100000:3.0:1784045279.381852:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873800704 00000100:00100000:3.0:1784045279.381916:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784045279.381926:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873800704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045279.381969:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045279.382020:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873800704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045279.382027:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784045279.382082:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873800704:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784045280.211875:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045280.915614:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873800832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045280.915704:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045280.916069:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873800832 00000100:00100000:3.0:1784045280.916077:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873800832 00000100:00100000:3.0:1784045280.916122:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784045280.916142:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873800832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784045280.916195:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784045280.916255:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873800832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045280.916263:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784045280.916321:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873800832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045280.918224:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873800960:0@lo:400:kworker.0 00000100:00100000:0.0:1784045280.918299:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045280.918335:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873800960 00000100:00100000:2.0:1784045280.918343:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873800960 00000100:00100000:0.0:1784045280.918430:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045280.918437:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873801344:0@lo:400:kworker.0 00000100:00100000:0.0:1784045280.918483:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045280.918534:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873801344 00000100:00100000:3.0:1784045280.918539:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873801344 00000100:00100000:3.0:1784045280.918621:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784045280.918632:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873801344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.918655:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873801088:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.918684:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045280.918688:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873801344:12345-0@lo:400:kworker.0 Request processed in 59us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045280.918695:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784045280.918702:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873801600:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.918721:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045280.918738:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873802112:0@lo:400:kworker.0 00000100:00100000:2.0:1784045280.918751:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1784045280.918758:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045280.918759:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873800960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.918777:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784045280.918782:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873801216:0@lo:400:kworker.0 00000100:00100000:2.0:1784045280.918792:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873800960:12345-0@lo:400:kworker.0 Request processed in 34us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045280.918798:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1784045280.918799:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045280.918813:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873801728:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.918834:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045280.918928:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873802240:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.918949:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045280.919024:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873801088 00000100:00100000:1.0:1784045280.919028:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873801088 00000100:00100000:1.0:1784045280.919050:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873801600 00000100:00100000:1.0:1784045280.919052:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873801600 00000100:00100000:1.0:1784045280.919072:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873802112 00000100:00100000:1.0:1784045280.919074:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873802112 00000100:00100000:1.0:1784045280.919090:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873801216 00000100:00100000:1.0:1784045280.919092:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873801216 00000100:00100000:1.0:1784045280.919103:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784045280.919107:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873801088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919152:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873801088:12345-0@lo:400:kworker.0 Request processed in 44us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045280.919158:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784045280.919175:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784045280.919181:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873801600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919204:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873801600:12345-0@lo:400:kworker.0 Request processed in 24us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045280.919209:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784045280.919219:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784045280.919224:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873802112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919244:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873802112:12345-0@lo:400:kworker.0 Request processed in 21us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045280.919249:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784045280.919258:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784045280.919263:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873801216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919284:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873801216:12345-0@lo:400:kworker.0 Request processed in 21us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045280.919290:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784045280.919322:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873801728 00000100:00100000:1.0:1784045280.919325:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873801728 00000100:00100000:1.0:1784045280.919349:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873802240 00000100:00100000:1.0:1784045280.919352:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873802240 00000100:00100000:1.0:1784045280.919368:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784045280.919379:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873801728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919411:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873801728:12345-0@lo:400:kworker.0 Request processed in 32us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045280.919416:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784045280.919426:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784045280.919431:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873802240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919482:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873802240:12345-0@lo:400:kworker.0 Request processed in 50us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045280.919487:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1784045280.919506:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045280.919510:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045280.919513:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784045280.919532:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873801472:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919555:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045280.919573:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873801984:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919590:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045280.919624:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873801344:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919635:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873800960:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919652:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784045280.919658:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873801856:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919680:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045280.919697:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873802368:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919716:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045280.919737:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873801856 00000100:00100000:1.0:1784045280.919740:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873801856 00000100:00100000:1.0:1784045280.919769:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873802368 00000100:00100000:1.0:1784045280.919772:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873802368 00000100:00100000:1.0:1784045280.919788:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784045280.919793:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873801856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919824:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873801856:12345-0@lo:400:kworker.0 Request processed in 31us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045280.919830:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784045280.919841:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784045280.919846:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873802368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.919869:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873802368:12345-0@lo:400:kworker.0 Request processed in 24us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045280.919938:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784045280.919958:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873801472 00000100:00100000:1.0:1784045280.919962:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873801472 00000100:00100000:1.0:1784045280.920040:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873801984 00000100:00100000:1.0:1784045280.920043:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873801984 00000100:00100000:1.0:1784045280.920062:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784045280.920067:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873801472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.920097:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873801472:12345-0@lo:400:kworker.0 Request processed in 30us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045280.920103:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784045280.920114:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784045280.920120:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873801984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.920154:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873801984:12345-0@lo:400:kworker.0 Request processed in 34us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045280.920160:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1784045280.920178:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045280.920188:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045280.920190:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045280.920214:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873801216:0@lo:400:kworker.0 00010000:00080000:1.0:1784045280.920229:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b7100 x1870706873801728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045280.920239:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873801728:0@lo:400:kworker.0 00010000:00080000:1.0:1784045280.920250:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c91562a00 x1870706873802240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045280.920257:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873802240:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.920268:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873801088:0@lo:400:kworker.0 00010000:00080000:1.0:1784045280.920278:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b7b80 x1870706873801600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045280.920286:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873801600:0@lo:400:kworker.0 00010000:00080000:1.0:1784045280.920296:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c91561f80 x1870706873802112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045280.920303:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873802112:0@lo:400:kworker.0 00010000:00080000:1.0:1784045280.920345:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915c1500 x1870706873801856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045280.920353:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873801856:0@lo:400:kworker.0 00010000:00080000:1.0:1784045280.920363:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c91562d80 x1870706873802368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045280.920370:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873802368:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.920388:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873801472:0@lo:400:kworker.0 00000100:00100000:1.0:1784045280.920397:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873801984:0@lo:400:kworker.0 00010000:00010000:3.0:1784045281.236615:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784045281.336816:0:10917:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing yml_node 00000100:00100000:3.0:1784045281.430722:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873802624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045281.430813:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045281.430903:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873802624 00000100:00100000:3.0:1784045281.430911:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873802624 00000100:00100000:3.0:1784045281.430969:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784045281.430978:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873802624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784045281.431015:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045281.431063:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873802624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045281.431071:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1784045281.431112:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83566a00 x1870706873802624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045281.431146:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873802624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045281.431437:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873802496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045281.431483:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045281.432696:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873802496 00000100:00100000:3.0:1784045281.432708:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873802496 00000100:00100000:3.0:1784045281.432768:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784045281.432777:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873802496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784045281.432806:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045281.432880:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873802496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045281.432887:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1784045281.432935:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820d180 x1870706873802496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045281.432957:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873802496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045281.477648:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045281.477705:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045281.477729:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045281.477820:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045281.477858:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863252096 00000100:00100000:2.0:1784045281.477870:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863252096 00000100:00100000:2.0:1784045281.477957:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863251968 00000100:00100000:2.0:1784045281.477961:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863251968 00000100:00100000:2.0:1784045281.477987:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 82 00000100:00100000:2.0:1784045281.477999:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863252096:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045281.478096:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863252096:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 99us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045281.478104:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 82 00000100:00100000:2.0:1784045281.478122:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 83 00000100:00100000:2.0:1784045281.478146:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2397:x1870706863251968:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045281.478175:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2397:x1870706863251968:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 32us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045281.478181:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 83 00000100:00080000:2.0:1784045281.478203:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045281.478207:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045281.478364:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863252224 00000100:00100000:0.0:1784045281.478370:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863252224 00000100:00100000:0.0:1784045281.478419:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:0.0:1784045281.478426:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2393:x1870706863252224:12345-192.168.203.44@tcp:9:kworker.0 00000020:00000080:0.0:1784045281.478475:0:8413:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c5bf 00000100:00080000:0.0:1784045281.478487:0:8413:0:(import.c:65:import_set_state_nolock()) ffff939b833a9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784045281.478552:0:8413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1784045281.478720:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+2:2393:x1870706863252224:12345-192.168.203.44@tcp:9:kworker.0 Request processed in 294us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045281.478727:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:0.0:1784045281.478750:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863251840 00000100:00100000:0.0:1784045281.478754:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863251840 00000100:00100000:0.0:1784045281.478783:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 277 00000100:00100000:0.0:1784045281.478790:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2397:x1870706863251840:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045281.478815:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2397:x1870706863251840:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045281.478822:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 277 00010000:00010000:0.0:1784045281.479028:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784045281.479520:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045281.480695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045281.480882:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863252352 00000100:00100000:2.0:1784045281.480895:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863252352 00000100:00100000:2.0:1784045281.480979:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:2.0:1784045281.480991:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2393:x1870706863252352:12345-192.168.203.44@tcp:9:kworker.0 00000020:00000080:2.0:1784045281.481034:0:9935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c5c6 00000100:00080000:2.0:1784045281.481046:0:9935:0:(import.c:65:import_set_state_nolock()) ffff939b833ae800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784045281.481190:0:9935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1784045281.481378:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+2:2393:x1870706863252352:12345-192.168.203.44@tcp:9:kworker.0 Request processed in 388us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045281.481388:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00010000:00010000:2.0:1784045281.481485:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784045281.481736:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784045282.264367:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045283.286852:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045283.989288:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045283.989325:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873802752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045283.989424:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045283.989678:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873802752 00000100:00100000:2.0:1784045283.989688:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873802752 00000100:00100000:2.0:1784045283.989764:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784045283.989775:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873802752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045283.989812:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1784045283.990058:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045283.990273:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873802880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045283.993230:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873802752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3445us (3794us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045283.993247:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1784045283.998794:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820d180 x1870706873802752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045283.998829:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873802752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045284.000283:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045284.006046:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873802880 00000100:00100000:1.0:1784045284.006071:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873802880 00000100:00100000:1.0:1784045284.006303:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784045284.006316:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873802880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045284.006355:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045284.006499:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873802880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 186us (6224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045284.006508:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1784045284.006634:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b4380 x1870706873802880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045284.006661:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873802880:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784045284.007277:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784045284.307751:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045284.499712:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873803008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045284.499813:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045284.500226:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873803008 00000100:00100000:0.0:1784045284.500236:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873803008 00000100:00100000:0.0:1784045284.500304:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784045284.500316:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873803008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045284.500377:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045284.500480:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873803008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045284.500488:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784045284.500698:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873803008:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784045285.334621:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045286.036105:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873803520:0@lo:400:kworker.0 00000100:00100000:2.0:1784045286.036196:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045286.036258:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873804032:0@lo:400:kworker.0 00000100:00100000:2.0:1784045286.036285:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045286.036308:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873804544:0@lo:400:kworker.0 00000100:00100000:2.0:1784045286.036353:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045286.036381:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784045286.036388:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873803392:0@lo:400:kworker.0 00000100:00100000:2.0:1784045286.036414:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045286.036439:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873803904:0@lo:400:kworker.0 00000100:00100000:2.0:1784045286.036504:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045286.036524:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873804416:0@lo:400:kworker.0 00000100:00100000:2.0:1784045286.036556:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045286.036589:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873803520 00000100:00100000:2.0:1784045286.036596:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873803520 00000100:00100000:2.0:1784045286.036648:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873803904 00000100:00100000:2.0:1784045286.036652:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873803904 00000100:00100000:2.0:1784045286.036673:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873804416 00000100:00100000:2.0:1784045286.036676:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873804416 00000100:00100000:2.0:1784045286.036691:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784045286.036699:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873803520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045286.036763:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873803520:12345-0@lo:400:kworker.0 Request processed in 64us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045286.036771:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784045286.036788:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784045286.036794:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873803904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045286.036823:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873803904:12345-0@lo:400:kworker.0 Request processed in 30us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045286.036829:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784045286.036840:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784045286.036845:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873804416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045286.036872:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873804416:12345-0@lo:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045286.036877:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1784045286.036898:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1784045286.036939:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c91561f80 x1870706873803904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045286.036953:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873803904:0@lo:400:kworker.0 00010000:00080000:2.0:1784045286.036976:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83380700 x1870706873804416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045286.036983:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873804416:0@lo:400:kworker.0 00000100:00100000:2.0:1784045286.036993:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873803520:0@lo:400:kworker.0 00000100:00100000:3.0:1784045286.037490:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873803392 00000100:00100000:3.0:1784045286.037508:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873803392 00000100:00100000:3.0:1784045286.037585:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784045286.037596:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873803392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045286.037666:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873803136:0@lo:400:kworker.0 00000100:00100000:3.0:1784045286.037712:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873803392:12345-0@lo:400:kworker.0 Request processed in 116us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045286.037722:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784045286.037743:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045286.037777:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873803264:0@lo:400:kworker.0 00000100:00100000:0.0:1784045286.037795:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873803648:0@lo:400:kworker.0 00000100:00100000:3.0:1784045286.037834:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045286.037853:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045286.037875:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873803776:0@lo:400:kworker.0 00000100:00100000:0.0:1784045286.037894:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873804160:0@lo:400:kworker.0 00000100:00100000:3.0:1784045286.037916:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045286.037941:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045286.037946:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873804288:0@lo:400:kworker.0 00000100:00100000:0.0:1784045286.037972:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873804672:0@lo:400:kworker.0 00000100:00100000:3.0:1784045286.038015:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045286.038033:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045286.038117:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873804032 00000100:00100000:3.0:1784045286.038119:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873803392:0@lo:400:kworker.0 00000100:00100000:0.0:1784045286.038126:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873804032 00000100:00100000:0.0:1784045286.038201:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873804544 00000100:00100000:0.0:1784045286.038206:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873804544 00000100:00100000:2.0:1784045286.038415:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873803264 00000100:00100000:2.0:1784045286.038421:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873803264 00000100:00100000:2.0:1784045286.038482:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873803776 00000100:00100000:2.0:1784045286.038485:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873803776 00000100:00100000:2.0:1784045286.038503:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873804288 00000100:00100000:2.0:1784045286.038505:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873804288 00000100:00100000:2.0:1784045286.038524:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784045286.038532:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873803264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045286.038567:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784045286.038582:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873803776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045286.038617:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873804160 00000100:00100000:3.0:1784045286.038624:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873804160 00000100:00100000:3.0:1784045286.038660:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873804672 00000100:00100000:3.0:1784045286.038664:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873804672 00000100:00100000:1.0:1784045286.038672:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873803776:12345-0@lo:400:kworker.0 Request processed in 89us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045286.038683:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784045286.038694:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784045286.038706:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873804032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045286.038727:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784045286.038740:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873804288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045286.038773:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873804032:12345-0@lo:400:kworker.0 Request processed in 68us (2485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045286.038781:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784045286.038808:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784045286.038816:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873804288:12345-0@lo:400:kworker.0 Request processed in 77us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045286.038823:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873804544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045286.038833:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784045286.038879:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784045286.038881:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873804544:12345-0@lo:400:kworker.0 Request processed in 61us (2522us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045286.038892:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784045286.038895:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873804160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045286.038918:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784045286.038929:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873804672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045286.038957:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873804160:12345-0@lo:400:kworker.0 Request processed in 65us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045286.038968:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784045286.038987:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873804672:12345-0@lo:400:kworker.0 Request processed in 58us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045286.038997:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784045286.039004:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873803136 00000100:00100000:1.0:1784045286.039011:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873803136 00000100:00100000:3.0:1784045286.039040:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873803648 00000100:00100000:3.0:1784045286.039048:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873803648 00000100:00100000:1.0:1784045286.039055:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1784045286.039070:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873803136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045286.039089:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784045286.039110:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873803648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045286.039133:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873803136:12345-0@lo:400:kworker.0 Request processed in 68us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045286.039141:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1784045286.039167:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873803648:12345-0@lo:400:kworker.0 Request processed in 67us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045286.039185:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784045286.039218:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873804800:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1784045286.039770:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045286.039779:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045286.039782:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045286.040062:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045286.040141:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873803776:0@lo:400:kworker.0 00000100:00100000:3.0:1784045286.040159:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873804288:0@lo:400:kworker.0 00000100:00100000:3.0:1784045286.040215:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873804800 00000100:00100000:3.0:1784045286.040220:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873804800 00000100:00100000:3.0:1784045286.040254:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784045286.040261:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873804800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784045286.040305:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784045286.040348:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873804800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045286.040366:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784045286.040404:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873804800:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1784045286.040471:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c91562a00 x1870706873804032/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045286.040484:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873804032:0@lo:400:kworker.0 00010000:00080000:3.0:1784045286.040499:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83381180 x1870706873804544/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045286.040508:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873804544:0@lo:400:kworker.0 00000100:00100000:1.0:1784045286.049352:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873803136:0@lo:400:kworker.0 00000100:00100000:1.0:1784045286.049403:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91560700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873803648:0@lo:400:kworker.0 00010000:00080000:1.0:1784045286.049419:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83382680 x1870706873804160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045286.049441:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873804160:0@lo:400:kworker.0 00010000:00080000:1.0:1784045286.049471:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83381f80 x1870706873804672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045286.049501:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873804672:0@lo:400:kworker.0 00000100:00100000:2.0:1784045286.058216:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873803264:12345-0@lo:400:kworker.0 Request processed in 19669us (20368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045286.058236:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784045286.059856:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873803264:0@lo:400:kworker.0 00010000:00010000:0.0:1784045286.356777:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045286.549554:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873804928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045286.549636:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045286.551781:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873804928 00000100:00100000:3.0:1784045286.551820:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873804928 00000100:00100000:3.0:1784045286.551906:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784045286.551917:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873804928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784045286.551958:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045286.552064:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873804928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (2428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045286.552072:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1784045286.553399:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83565f80 x1870706873804928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045286.553430:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873804928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045286.554884:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873805056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045286.554976:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045286.558324:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873805056 00000100:00100000:1.0:1784045286.558343:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873805056 00000100:00100000:1.0:1784045286.558429:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784045286.558440:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873805056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784045286.558496:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045286.558612:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873805056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 174us (3637us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045286.558621:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1784045286.559341:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a1880 x1870706873805056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045286.559370:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873805056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045286.604570:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045286.604636:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045286.604675:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045286.604712:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863252736 00000100:00100000:3.0:1784045286.604724:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863252736 00000100:00100000:3.0:1784045286.604797:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863252608 00000100:00100000:3.0:1784045286.604801:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863252608 00000100:00100000:3.0:1784045286.604827:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 90 00000100:00100000:3.0:1784045286.604837:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863252736:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045286.604929:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863252736:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 93us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045286.604937:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 90 00000100:00100000:3.0:1784045286.604954:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 91 00000100:00100000:3.0:1784045286.604961:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863252608:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045286.604988:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863252608:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045286.604994:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 91 00000100:00100000:2.0:1784045286.605550:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863252480 00000100:00100000:2.0:1784045286.605557:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863252480 00000100:00100000:2.0:1784045286.605616:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 279 00000100:00100000:2.0:1784045286.605625:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2395:x1870706863252480:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045286.605665:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2395:x1870706863252480:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 42us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045286.605672:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 279 00000100:00080000:1.0:1784045286.606310:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045286.606318:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:3.0:1784045287.069193:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000020:00000080:3.0:1784045287.069207:0:8407:0:(genops.c:906:class_export_put()) final put ffff939b833a9000/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000020:00000080:3.0:1784045287.069259:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff939b833a9000/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 for lustre-OST0000 00000020:00000080:3.0:1784045287.069315:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b833a9800 for lustre-OST0000 00000001:00100000:3.0:1784045287.069577:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000020:00000080:3.0:1784045287.069582:0:9491:0:(genops.c:906:class_export_put()) final put ffff939b833ad000/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000020:00000080:2.0:1784045287.069633:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939b833ad000/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 for lustre-OST0001 00000020:00000080:2.0:1784045287.069668:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b833ae800 for lustre-OST0001 00010000:00010000:2.0:1784045287.379832:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784045287.879163:0:11101:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00010000:00010000:1.0:1784045288.408869:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045289.108424:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873805184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784045289.108547:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045289.108624:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045289.108632:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873805312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045289.108658:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045289.112494:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873805184 00000100:00100000:2.0:1784045289.112532:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873805184 00000100:00100000:2.0:1784045289.112630:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873805312 00000100:00100000:2.0:1784045289.112634:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873805312 00000100:00100000:2.0:1784045289.112665:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784045289.112676:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873805184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784045289.112717:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045289.113473:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1784045289.113491:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045289.113504:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873805312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045289.113522:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045289.113633:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873805312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (4973us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045289.113641:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1784045289.113784:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a1c00 x1870706873805312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045289.113811:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873805312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045289.114179:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873805184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1504us (5631us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045289.114186:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1784045289.114318:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83382680 x1870706873805184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045289.114332:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873805184:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784045289.428042:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045289.619833:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045289.619856:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873805440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045289.619920:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045289.620498:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873805440 00000100:00100000:3.0:1784045289.620506:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873805440 00000100:00100000:3.0:1784045289.620550:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784045289.620559:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873805440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045289.620591:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045289.620698:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873805440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045289.620705:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784045289.622231:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873805440:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784045290.452363:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045291.155760:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045291.155790:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873805824:0@lo:400:kworker.0 00000100:00100000:3.0:1784045291.155878:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045291.155956:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873805824 00000100:00100000:3.0:1784045291.155964:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873805824 00000100:00100000:2.0:1784045291.156012:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873805696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045291.156022:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784045291.156034:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873805824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045291.156106:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045291.156114:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873805824:12345-0@lo:400:kworker.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045291.156141:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784045291.156158:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873806336:0@lo:400:kworker.0 00000100:00100000:3.0:1784045291.156177:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873805696 00000100:00100000:3.0:1784045291.156184:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873805696 00000100:00100000:2.0:1784045291.156213:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045291.156218:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784045291.156227:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873805696:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045291.156257:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873806848:0@lo:400:kworker.0 00000004:00000024:3.0:1784045291.156258:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784045291.156301:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045291.156323:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873805696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045291.156331:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784045291.156380:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873805824:0@lo:400:kworker.0 00000100:00100000:2.0:1784045291.156405:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873805696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045291.156486:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784045291.156498:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873806208:0@lo:400:kworker.0 00000100:00100000:2.0:1784045291.156532:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045291.156561:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873806720:0@lo:400:kworker.0 00000100:00100000:2.0:1784045291.156585:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045291.156611:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873807232:0@lo:400:kworker.0 00000100:00100000:2.0:1784045291.156630:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045291.156833:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873806336 00000100:00100000:0.0:1784045291.156840:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873806336 00000100:00100000:0.0:1784045291.156894:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873806848 00000100:00100000:0.0:1784045291.156897:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873806848 00000100:00100000:0.0:1784045291.156915:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784045291.156923:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873806336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045291.156986:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873806336:12345-0@lo:400:kworker.0 Request processed in 63us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045291.156993:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784045291.157008:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784045291.157013:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873806848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045291.157039:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873806848:12345-0@lo:400:kworker.0 Request processed in 27us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045291.157045:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784045291.157074:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873806208 00000100:00100000:0.0:1784045291.157078:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873806208 00000100:00100000:0.0:1784045291.157100:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784045291.157106:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873806208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045291.157139:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873806208:12345-0@lo:400:kworker.0 Request processed in 32us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045291.157158:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784045291.158074:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873805568:0@lo:400:kworker.0 00000100:00100000:1.0:1784045291.158133:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045291.158183:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873806080:0@lo:400:kworker.0 00000100:00100000:1.0:1784045291.158227:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045291.158249:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873806592:0@lo:400:kworker.0 00000100:00100000:1.0:1784045291.158271:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045291.158288:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873807104:0@lo:400:kworker.0 00000100:00100000:1.0:1784045291.158304:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045291.158471:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873805568 00000100:00100000:0.0:1784045291.158478:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873805568 00000100:00100000:0.0:1784045291.158517:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1784045291.158525:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873805568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045291.158577:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873805568:12345-0@lo:400:kworker.0 Request processed in 50us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045291.158584:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1784045291.158612:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873806720 00000100:00100000:3.0:1784045291.158625:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873806720 00000100:00100000:0.0:1784045291.158627:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873807232 00000100:00100000:0.0:1784045291.158633:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873807232 00000100:00100000:0.0:1784045291.158692:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873806592 00000100:00100000:0.0:1784045291.158696:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873806592 00000100:00080000:2.0:1784045291.158761:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045291.158778:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045291.158781:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045291.158825:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873806208:0@lo:400:kworker.0 00000100:00100000:2.0:1784045291.158842:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873806336:0@lo:400:kworker.0 00000100:00100000:2.0:1784045291.158852:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873806848:0@lo:400:kworker.0 00000100:00100000:2.0:1784045291.158932:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873806080 00000100:00100000:2.0:1784045291.158936:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873806080 00000100:00100000:1.0:1784045291.159309:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1784045291.159335:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873805952:0@lo:400:kworker.0 00000100:00100000:1.0:1784045291.159383:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045291.159413:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873806464:0@lo:400:kworker.0 00000100:00100000:1.0:1784045291.159438:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045291.159475:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873806976:0@lo:400:kworker.0 00000100:00100000:1.0:1784045291.159498:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045291.159518:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873805568:0@lo:400:kworker.0 00000100:00100000:1.0:1784045291.159556:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873806464 00000100:00100000:1.0:1784045291.159560:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873806464 00000100:00100000:1.0:1784045291.159591:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873806976 00000100:00100000:1.0:1784045291.159595:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873806976 00000100:00100000:1.0:1784045291.159609:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784045291.159615:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873806464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045291.159659:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873806464:12345-0@lo:400:kworker.0 Request processed in 44us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045291.159676:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784045291.159698:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784045291.159704:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873806976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045291.159733:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873806976:12345-0@lo:400:kworker.0 Request processed in 30us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045291.159739:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784045291.160163:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784045291.160171:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873806080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045291.161053:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873806080:12345-0@lo:400:kworker.0 Request processed in 879us (2822us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045291.161062:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784045291.163971:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873807104 00000100:00100000:3.0:1784045291.163986:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873807104 00000100:00100000:3.0:1784045291.164031:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784045291.164040:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873807232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045291.164191:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873807232:12345-0@lo:400:kworker.0 Request processed in 151us (7558us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045291.164199:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784045291.164215:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784045291.164221:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873806720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045291.164613:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873806720:12345-0@lo:400:kworker.0 Request processed in 392us (8026us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045291.164621:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784045291.164635:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784045291.164641:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873806592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045291.164673:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873806592:12345-0@lo:400:kworker.0 Request processed in 33us (6401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045291.164692:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784045291.164706:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784045291.164711:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873807104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045291.164742:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873807104:12345-0@lo:400:kworker.0 Request processed in 32us (6437us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045291.164747:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784045291.164771:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873805952 00000100:00100000:3.0:1784045291.164775:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873805952 00000100:00100000:3.0:1784045291.164803:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784045291.164808:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873805952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045291.165522:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873805952:12345-0@lo:400:kworker.0 Request processed in 710us (6136us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045291.165530:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1784045291.165580:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a0380 x1870706873806720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045291.165595:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873806720:0@lo:400:kworker.0 00010000:00080000:3.0:1784045291.165608:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a1880 x1870706873807232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045291.165617:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873807232:0@lo:400:kworker.0 00000100:00080000:0.0:1784045291.172076:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045291.172091:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045291.172181:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873805952:0@lo:400:kworker.0 00010000:00080000:0.0:1784045291.172227:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a1180 x1870706873806464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045291.172239:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873806464:0@lo:400:kworker.0 00010000:00080000:0.0:1784045291.172254:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a2a00 x1870706873806976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045291.172262:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873806976:0@lo:400:kworker.0 00000100:00100000:0.0:1784045291.172276:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873806080:0@lo:400:kworker.0 00010000:00080000:0.0:1784045291.172290:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a0e00 x1870706873806592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045291.172298:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873806592:0@lo:400:kworker.0 00010000:00080000:0.0:1784045291.172335:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a1c00 x1870706873807104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045291.172342:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873807104:0@lo:400:kworker.0 00010000:00010000:3.0:1784045291.477201:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784045291.566603:0:11198:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00000100:00100000:1.0:1784045291.667750:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045291.667790:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873807360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045291.667886:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045291.667972:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873807360 00000100:00100000:1.0:1784045291.667981:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873807360 00000100:00100000:1.0:1784045291.668044:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784045291.668070:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873807360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784045291.668108:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045291.668162:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873807360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045291.668170:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1784045291.668233:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a1c00 x1870706873807360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045291.668255:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873807360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045291.668590:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045291.668603:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873807488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045291.668644:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045291.668748:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873807488 00000100:00100000:2.0:1784045291.668754:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873807488 00000100:00100000:2.0:1784045291.668795:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784045291.668804:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873807488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045291.668816:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045291.668859:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873807488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045291.668866:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1784045291.668895:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a0e00 x1870706873807488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045291.668909:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873807488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045291.735001:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045291.735050:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045291.735095:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045291.735130:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863252864 00000100:00100000:3.0:1784045291.735157:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863252864 00000100:00100000:3.0:1784045291.735224:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 281 00000100:00100000:3.0:1784045291.735236:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2396:x1870706863252864:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045291.735322:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2396:x1870706863252864:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 89us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045291.735435:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 281 00000100:00100000:3.0:1784045291.735505:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863253120 00000100:00100000:3.0:1784045291.735509:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863253120 00000100:00100000:3.0:1784045291.735552:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863252992 00000100:00100000:3.0:1784045291.735556:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863252992 00000100:00100000:3.0:1784045291.735582:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 98 00000100:00100000:3.0:1784045291.735589:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863253120:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045291.735632:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863253120:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 43us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045291.735639:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 98 00000100:00100000:3.0:1784045291.735651:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 99 00000100:00100000:3.0:1784045291.735656:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863252992:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045291.735678:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863252992:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 22us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045291.735683:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 99 00000100:00080000:3.0:1784045291.736260:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784045291.736266:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784045292.500514:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045293.524625:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045294.227800:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045294.227833:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873807616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045294.227934:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045294.228062:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873807616 00000100:00100000:0.0:1784045294.228071:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873807616 00000100:00100000:0.0:1784045294.228160:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784045294.228173:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873807616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784045294.228224:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045294.228279:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873807616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045294.228288:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1784045294.228338:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a5c00 x1870706873807616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045294.228373:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873807616:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784045294.228821:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045294.234870:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873807744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045294.234978:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045294.235124:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873807744 00000100:00100000:2.0:1784045294.235135:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873807744 00000100:00100000:2.0:1784045294.235217:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784045294.235228:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873807744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045294.235257:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045294.252568:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873807744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 17324us (17571us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045294.252589:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1784045294.252706:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784045294.255734:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a0e00 x1870706873807744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045294.255799:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873807744:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784045294.547704:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045294.740860:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873807872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784045294.740937:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045294.741113:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873807872 00000100:00100000:3.0:1784045294.741126:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873807872 00000100:00100000:3.0:1784045294.741178:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784045294.741187:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873807872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045294.741221:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045294.741272:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873807872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045294.741288:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784045294.741332:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873807872:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1784045295.063699:0:11296:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00010000:00010000:0.0:1784045295.572061:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045296.279480:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873808000:0@lo:400:kworker.0 00000100:00100000:2.0:1784045296.279555:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045296.279602:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873808512:0@lo:400:kworker.0 00000100:00100000:2.0:1784045296.279646:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045296.279668:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873809024:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.279824:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873808128:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.279855:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045296.279875:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873808640:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.279894:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045296.279910:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873809152:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.279929:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045296.279943:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873809664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045296.279961:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045296.279989:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873808256:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.280007:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045296.280021:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873808768:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.280049:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045296.280073:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873809280:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.280103:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045296.280116:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784045296.280121:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873808384:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.280139:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045296.280147:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873808896:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.280175:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873808128 00000100:00100000:3.0:1784045296.280180:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873808128 00000100:00100000:3.0:1784045296.280212:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873808640 00000100:00100000:3.0:1784045296.280215:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873808640 00000100:00100000:3.0:1784045296.280239:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873809152 00000100:00100000:3.0:1784045296.280242:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873809152 00000100:00100000:3.0:1784045296.280254:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873808768 00000100:00100000:3.0:1784045296.280256:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873808768 00000100:00100000:3.0:1784045296.280270:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873809280 00000100:00100000:3.0:1784045296.280272:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873809280 00000100:00100000:3.0:1784045296.280283:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873808384 00000100:00100000:3.0:1784045296.280285:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873808384 00000100:00100000:3.0:1784045296.280304:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784045296.280314:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873808128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.280382:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873808128:12345-0@lo:400:kworker.0 Request processed in 68us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.280391:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784045296.280411:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784045296.280416:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873808640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.280465:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873808640:12345-0@lo:400:kworker.0 Request processed in 28us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.280471:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784045296.280491:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784045296.280496:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873809152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.280520:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873809152:12345-0@lo:400:kworker.0 Request processed in 25us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.280526:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784045296.280534:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784045296.280538:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873808768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.280565:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873808768:12345-0@lo:400:kworker.0 Request processed in 26us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.280570:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784045296.280579:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784045296.280584:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873809280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.280605:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873809280:12345-0@lo:400:kworker.0 Request processed in 22us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.280611:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784045296.280620:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784045296.280625:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873808384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.280644:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873808384:12345-0@lo:400:kworker.0 Request processed in 20us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.280649:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784045296.280671:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873808512 00000100:00100000:3.0:1784045296.280674:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873808512 00000100:00100000:3.0:1784045296.280687:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873809664 00000100:00100000:3.0:1784045296.280841:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873809664 00000100:00100000:3.0:1784045296.280861:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873808256 00000100:00100000:3.0:1784045296.280865:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873808256 00000100:00100000:3.0:1784045296.280877:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784045296.280889:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873808512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.280925:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873808512:12345-0@lo:400:kworker.0 Request processed in 37us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.280932:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784045296.280942:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784045296.280947:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1870706873809664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784045296.280969:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784045296.280993:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1870706873809664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.280999:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784045296.281008:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784045296.281013:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873808256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.281045:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873808256:12345-0@lo:400:kworker.0 Request processed in 32us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.281051:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1784045296.281088:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784045296.281092:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045296.281120:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873808128:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.281131:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873808640:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.281139:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873809152:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.281154:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873809664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045296.281230:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873808000 00000100:00100000:3.0:1784045296.281233:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873808000 00000100:00100000:3.0:1784045296.281257:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1784045296.281264:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873808000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.281299:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873808000:12345-0@lo:400:kworker.0 Request processed in 36us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.281305:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1784045296.281582:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045296.281621:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873809536:0@lo:400:kworker.0 00000100:00100000:2.0:1784045296.281646:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045296.281669:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873808000:0@lo:400:kworker.0 00000100:00100000:2.0:1784045296.281678:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873808512:0@lo:400:kworker.0 00000100:00100000:2.0:1784045296.281712:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873809024 00000100:00100000:2.0:1784045296.281715:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873809024 00000100:00100000:2.0:1784045296.281737:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873809536 00000100:00100000:2.0:1784045296.281740:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873809536 00000100:00100000:2.0:1784045296.281754:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784045296.281759:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873809024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045296.281787:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873809024:12345-0@lo:400:kworker.0 Request processed in 29us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045296.281802:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784045296.281812:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784045296.281817:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873809536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045296.281840:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873809536:12345-0@lo:400:kworker.0 Request processed in 24us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045296.281844:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1784045296.281864:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a1f80 x1870706873809024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045296.281874:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873809024:0@lo:400:kworker.0 00010000:00080000:2.0:1784045296.281883:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a1c00 x1870706873809536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045296.281890:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873809536:0@lo:400:kworker.0 00000100:00080000:3.0:1784045296.282206:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045296.282209:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045296.282284:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045296.284929:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873809408:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.284994:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045296.285052:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873808256:0@lo:400:kworker.0 00010000:00080000:3.0:1784045296.285068:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a3b80 x1870706873808768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045296.285281:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873808768:0@lo:400:kworker.0 00010000:00080000:3.0:1784045296.285309:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a2680 x1870706873809280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045296.285319:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873809280:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.285381:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873808384:0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.285414:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873808896 00000100:00100000:3.0:1784045296.285420:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873808896 00000100:00100000:3.0:1784045296.285484:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873809408 00000100:00100000:3.0:1784045296.285487:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873809408 00000100:00100000:3.0:1784045296.285501:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784045296.285508:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873808896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.285558:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873808896:12345-0@lo:400:kworker.0 Request processed in 50us (3274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.285577:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784045296.285592:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784045296.285597:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873809408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045296.285621:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873809408:12345-0@lo:400:kworker.0 Request processed in 24us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.285627:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1784045296.285642:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045296.285645:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784045296.285659:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a3800 x1870706873808896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045296.285670:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873808896:0@lo:400:kworker.0 00010000:00080000:3.0:1784045296.285677:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a0e00 x1870706873809408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045296.285685:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873809408:0@lo:400:kworker.0 00010000:00010000:1.0:1784045296.596393:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045296.788723:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873809792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045296.788788:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045296.788841:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045296.788848:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873809920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045296.788872:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045296.788910:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873809792 00000100:00100000:2.0:1784045296.788916:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873809792 00000100:00100000:2.0:1784045296.788954:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873809920 00000100:00100000:2.0:1784045296.788957:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873809920 00000100:00100000:2.0:1784045296.788973:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784045296.788981:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873809792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784045296.789012:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045296.789076:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873809792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045296.789084:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784045296.789099:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784045296.789106:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873809920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045296.789115:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045296.789139:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873809920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045296.789145:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1784045296.789186:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b836d1180 x1870706873809920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045296.789206:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873809920:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1784045296.789217:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b836d1f80 x1870706873809792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045296.789227:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873809792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045296.833885:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045296.833918:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045296.833936:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045296.838218:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863253376 00000100:00100000:3.0:1784045296.838234:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863253376 00000100:00100000:3.0:1784045296.838309:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863253504 00000100:00100000:3.0:1784045296.838313:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863253504 00000100:00100000:3.0:1784045296.838341:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 106 00000100:00100000:3.0:1784045296.838351:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863253376:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045296.838428:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863253376:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 78us (4552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.838435:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 106 00000100:00100000:3.0:1784045296.838474:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 107 00000100:00100000:3.0:1784045296.838481:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863253504:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045296.838515:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863253504:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 35us (4578us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.838521:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 107 00000100:00100000:3.0:1784045296.838541:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863253248 00000100:00100000:3.0:1784045296.838545:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863253248 00000100:00100000:3.0:1784045296.838568:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 283 00000100:00100000:3.0:1784045296.838575:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2397:x1870706863253248:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045296.838597:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2397:x1870706863253248:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 23us (4679us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045296.838603:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 283 00000100:00080000:2.0:1784045296.838842:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045296.838847:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1784045296.880130:0:11344:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Jul 14 12:08:14 EDT 2026 00010000:00010000:3.0:1784045297.619812:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045298.649434:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045299.353151:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045299.353177:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873810048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045299.353243:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045299.356323:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873810176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045299.356394:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045299.356472:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873810048 00000100:00100000:2.0:1784045299.356481:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873810048 00000100:00100000:2.0:1784045299.356528:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873810176 00000100:00100000:2.0:1784045299.356531:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873810176 00000100:00100000:2.0:1784045299.356549:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784045299.356557:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873810048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045299.356587:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045299.356632:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873810048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045299.356639:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784045299.356656:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784045299.356662:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873810176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784045299.356678:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045299.356704:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873810176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045299.356709:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1784045299.356813:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784045299.356846:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d7800 x1870706873810176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045299.356865:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873810176:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1784045299.356877:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b836d3800 x1870706873810048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045299.356889:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873810048:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784045299.669602:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045299.860608:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045299.860631:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873810304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045299.860709:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045299.863100:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873810304 00000100:00100000:3.0:1784045299.863113:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873810304 00000100:00100000:3.0:1784045299.863192:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784045299.863202:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873810304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045299.863240:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045299.863335:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873810304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045299.863343:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784045299.863547:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873810304:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784045300.694259:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045301.395728:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045301.395752:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873810432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045301.395816:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045301.396995:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873810816:0@lo:400:kworker.0 00000100:00100000:1.0:1784045301.397054:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045301.397091:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873811328:0@lo:400:kworker.0 00000100:00100000:1.0:1784045301.397114:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045301.397139:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873811840:0@lo:400:kworker.0 00000100:00100000:1.0:1784045301.397161:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045301.397183:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784045301.397189:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873810944:0@lo:400:kworker.0 00000100:00100000:1.0:1784045301.397213:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045301.397268:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873810688:0@lo:400:kworker.0 00000100:00100000:2.0:1784045301.397299:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045301.397323:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873811200:0@lo:400:kworker.0 00000100:00100000:2.0:1784045301.397345:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045301.397363:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873811712:0@lo:400:kworker.0 00000100:00100000:0.0:1784045301.397384:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873810560:0@lo:400:kworker.0 00000100:00100000:2.0:1784045301.397386:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045301.397430:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873810816 00000100:00100000:2.0:1784045301.397438:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873810816 00000100:00100000:0.0:1784045301.397439:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045301.397504:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873811072:0@lo:400:kworker.0 00000100:00100000:2.0:1784045301.397507:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873810688 00000100:00100000:2.0:1784045301.397512:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873810688 00000100:00100000:2.0:1784045301.397544:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873811200 00000100:00100000:0.0:1784045301.397545:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045301.397549:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873811200 00000100:00100000:0.0:1784045301.397561:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873811584:0@lo:400:kworker.0 00000100:00100000:2.0:1784045301.397580:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873811712 00000100:00100000:2.0:1784045301.397585:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873811712 00000100:00100000:0.0:1784045301.397586:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045301.397608:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873811072 00000100:00100000:2.0:1784045301.397612:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873811072 00000100:00100000:0.0:1784045301.397618:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873810560 00000100:00100000:0.0:1784045301.397624:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873810560 00000100:00100000:2.0:1784045301.397628:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873811584 00000100:00100000:2.0:1784045301.397634:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873811584 00000100:00100000:2.0:1784045301.397658:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784045301.397667:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873810816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045301.397672:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1784045301.397682:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873810560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045301.397737:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873810560:12345-0@lo:400:kworker.0 Request processed in 56us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045301.397747:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1784045301.397748:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873810816:12345-0@lo:400:kworker.0 Request processed in 79us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045301.397758:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784045301.397777:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784045301.397785:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873810688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045301.397801:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873810560:0@lo:400:kworker.0 00000100:00100000:2.0:1784045301.397828:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873810688:12345-0@lo:400:kworker.0 Request processed in 44us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045301.397842:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873811328 00000100:00100000:2.0:1784045301.397843:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784045301.397846:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873811328 00000100:00100000:2.0:1784045301.397861:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784045301.397868:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873811200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045301.397897:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873811200:12345-0@lo:400:kworker.0 Request processed in 30us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045301.397903:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784045301.397913:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784045301.397919:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873811712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045301.397951:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873811712:12345-0@lo:400:kworker.0 Request processed in 32us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045301.397952:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873811840 00000100:00100000:0.0:1784045301.397957:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873811840 00000100:00100000:2.0:1784045301.397962:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784045301.397980:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784045301.397985:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784045301.397990:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873811072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045301.397996:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873811328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045301.398049:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873811072:12345-0@lo:400:kworker.0 Request processed in 61us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045301.398055:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873811328:12345-0@lo:400:kworker.0 Request processed in 61us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045301.398061:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784045301.398067:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784045301.398080:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784045301.398087:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784045301.398091:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873811584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045301.398098:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873811840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045301.398136:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873811584:12345-0@lo:400:kworker.0 Request processed in 47us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045301.398142:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873811840:12345-0@lo:400:kworker.0 Request processed in 46us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045301.398146:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784045301.398158:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1784045301.398182:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045301.398187:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045301.398190:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045301.398192:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045301.398223:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873810688:0@lo:400:kworker.0 00010000:00080000:0.0:1784045301.398239:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d6a00 x1870706873811200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045301.398250:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873811200:0@lo:400:kworker.0 00000100:00100000:2.0:1784045301.398254:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873811072:0@lo:400:kworker.0 00010000:00080000:0.0:1784045301.398267:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6925180 x1870706873811712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045301.398273:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873811584:0@lo:400:kworker.0 00000100:00100000:0.0:1784045301.398282:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873811712:0@lo:400:kworker.0 00000100:00100000:1.0:1784045301.399109:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873811456:0@lo:400:kworker.0 00000100:00100000:1.0:1784045301.399148:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045301.399168:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873811968:0@lo:400:kworker.0 00000100:00100000:1.0:1784045301.399190:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045301.399217:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873810816:0@lo:400:kworker.0 00010000:00080000:1.0:1784045301.399230:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d7800 x1870706873811328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045301.399240:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873811328:0@lo:400:kworker.0 00010000:00080000:1.0:1784045301.399251:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6925c00 x1870706873811840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045301.399259:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873811840:0@lo:400:kworker.0 00000100:00100000:3.0:1784045301.399464:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873810432 00000100:00100000:0.0:1784045301.399468:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873811456 00000100:00100000:3.0:1784045301.399473:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873810432 00000100:00100000:0.0:1784045301.399474:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873811456 00000100:00100000:3.0:1784045301.399519:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873810944 00000100:00100000:3.0:1784045301.399523:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873810944 00000100:00100000:1.0:1784045301.399547:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784045301.399560:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873810432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045301.399589:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784045301.399628:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873810432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (3811us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045301.399675:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873811968 00000100:00100000:0.0:1784045301.399678:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873811968 00000100:00100000:0.0:1784045301.399694:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784045301.399700:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873811456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045301.399730:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873811456:12345-0@lo:400:kworker.0 Request processed in 31us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045301.399735:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784045301.399746:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784045301.399751:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873811968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045301.399772:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873811968:12345-0@lo:400:kworker.0 Request processed in 21us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045301.399777:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1784045301.399805:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045301.399809:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784045301.399836:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6924380 x1870706873811456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045301.399845:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873811456:0@lo:400:kworker.0 00010000:00080000:0.0:1784045301.399866:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6926a00 x1870706873811968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045301.399875:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873811968:0@lo:400:kworker.0 00000100:00100000:0.0:1784045301.399888:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873810432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045301.402830:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784045301.403620:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784045301.403643:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873810944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045301.403983:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873810944:0@lo:400:kworker.0 00000100:00100000:3.0:1784045301.404617:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873810944:12345-0@lo:400:kworker.0 Request processed in 216us (6632us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045301.404639:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00010000:0.0:1784045301.719818:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045301.907863:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873812096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045301.907934:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045301.908202:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873812224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045301.908233:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045301.908479:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873812096 00000100:00100000:0.0:1784045301.908487:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873812096 00000100:00100000:0.0:1784045301.908536:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873812224 00000100:00100000:0.0:1784045301.908540:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873812224 00000100:00100000:0.0:1784045301.908556:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784045301.908564:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873812096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784045301.908593:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045301.908639:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873812096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045301.908646:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784045301.908662:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784045301.908669:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873812224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045301.908678:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045301.908706:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873812224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045301.908712:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1784045301.908792:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a6300 x1870706873812224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045301.908811:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873812224:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1784045301.908902:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b836d3480 x1870706873812096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045301.908914:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873812096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045301.954741:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045301.954789:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045301.954820:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045301.954925:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863253888 00000100:00100000:0.0:1784045301.954928:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863253632 00000100:00100000:1.0:1784045301.954935:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863253888 00000100:00100000:0.0:1784045301.954948:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863253632 00000100:00100000:1.0:1784045301.955010:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863253760 00000100:00100000:0.0:1784045301.955011:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 285 00000100:00100000:1.0:1784045301.955015:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863253760 00000100:00100000:0.0:1784045301.955024:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2394:x1870706863253632:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045301.955043:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 114 00000100:00100000:1.0:1784045301.955064:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863253888:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045301.955092:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2394:x1870706863253632:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 70us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045301.955101:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 285 00000100:00100000:1.0:1784045301.955107:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863253888:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 53us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045301.955115:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 114 00000100:00100000:1.0:1784045301.955138:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 115 00000100:00100000:1.0:1784045301.955145:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863253760:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045301.955175:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863253760:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 31us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045301.955189:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 115 00000100:00080000:3.0:1784045301.956300:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784045301.956307:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784045302.753249:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045303.763594:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045304.469082:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873812352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045304.469151:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045304.470295:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873812480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784045304.470341:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045304.470480:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873812352 00000100:00100000:1.0:1784045304.470489:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873812352 00000100:00100000:1.0:1784045304.470537:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873812480 00000100:00100000:1.0:1784045304.470541:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873812480 00000100:00100000:1.0:1784045304.470559:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784045304.470567:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873812352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045304.470605:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045304.470652:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873812352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045304.470659:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784045304.470678:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784045304.470683:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873812480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045304.470693:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045304.470721:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873812480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045304.470727:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1784045304.470743:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784045304.470771:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6927800 x1870706873812480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045304.470789:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873812480:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1784045304.470816:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a3b80 x1870706873812352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045304.470828:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873812352:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784045304.788428:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045304.980510:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873812608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045304.980580:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045304.982328:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873812608 00000100:00100000:0.0:1784045304.982340:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873812608 00000100:00100000:0.0:1784045304.982407:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784045304.982418:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873812608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045304.982474:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045304.982550:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873812608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045304.982571:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784045304.982620:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873812608:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784045305.812582:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045306.516624:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873812736:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.516721:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045306.516792:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873813248:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.516824:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045306.516847:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873813760:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.516872:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045306.516894:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873814272:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.516915:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045306.516943:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784045306.516950:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873813120:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.516988:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045306.517010:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873813632:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.517031:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045306.517048:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873814144:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.517067:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045306.517100:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873812864:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.517126:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045306.517147:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873813376:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.517168:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045306.517187:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873813888:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.517224:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045306.517246:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784045306.517252:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873812992:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.517276:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045306.517295:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873813504:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.517330:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045306.517345:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873814016:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.517367:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045306.517401:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873812736 00000100:00100000:2.0:1784045306.517409:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873812736 00000100:00100000:2.0:1784045306.517491:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1784045306.517502:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873812736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.517564:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873812736:12345-0@lo:400:kworker.0 Request processed in 64us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.517573:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1784045306.517614:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873813248 00000100:00100000:2.0:1784045306.517617:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873813248 00000100:00100000:2.0:1784045306.517643:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873812992 00000100:00100000:2.0:1784045306.517646:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873812992 00000100:00100000:2.0:1784045306.517661:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784045306.517667:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873813248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.517707:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873813248:12345-0@lo:400:kworker.0 Request processed in 39us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.517713:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784045306.517726:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784045306.517731:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873812992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.517776:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873812992:12345-0@lo:400:kworker.0 Request processed in 45us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.517783:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784045306.517802:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873813760 00000100:00100000:2.0:1784045306.517805:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873813760 00000100:00100000:2.0:1784045306.517843:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873814272 00000100:00100000:2.0:1784045306.517846:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873814272 00000100:00100000:2.0:1784045306.517860:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873813632 00000100:00100000:2.0:1784045306.517862:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873813632 00000100:00100000:2.0:1784045306.517874:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873814144 00000100:00100000:2.0:1784045306.517876:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873814144 00000100:00100000:2.0:1784045306.517890:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784045306.517896:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873813760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.517929:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873813760:12345-0@lo:400:kworker.0 Request processed in 33us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.517935:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784045306.517946:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784045306.517952:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873814272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.517994:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873814272:12345-0@lo:400:kworker.0 Request processed in 42us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.518000:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784045306.518012:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784045306.518017:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873813632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518046:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873813632:12345-0@lo:400:kworker.0 Request processed in 29us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.518052:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784045306.518063:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784045306.518076:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873814144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518106:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873814144:12345-0@lo:400:kworker.0 Request processed in 31us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.518112:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784045306.518139:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873813120 00000100:00100000:2.0:1784045306.518142:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873813120 00000100:00100000:2.0:1784045306.518161:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873812864 00000100:00100000:2.0:1784045306.518165:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873812864 00000100:00100000:2.0:1784045306.518176:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873813376 00000100:00100000:2.0:1784045306.518179:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873813376 00000100:00100000:2.0:1784045306.518190:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873813888 00000100:00100000:2.0:1784045306.518192:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873813888 00000100:00100000:2.0:1784045306.518203:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873813504 00000100:00100000:2.0:1784045306.518206:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873813504 00000100:00100000:2.0:1784045306.518219:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873814016 00000100:00100000:2.0:1784045306.518222:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873814016 00000100:00100000:2.0:1784045306.518236:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784045306.518242:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873813120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518287:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873813120:12345-0@lo:400:kworker.0 Request processed in 45us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.518294:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784045306.518307:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1784045306.518313:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873812864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518342:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873812864:12345-0@lo:400:kworker.0 Request processed in 29us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.518348:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1784045306.518360:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784045306.518366:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873813376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518404:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873813376:12345-0@lo:400:kworker.0 Request processed in 39us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.518411:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784045306.518423:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784045306.518429:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873813888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518485:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873813888:12345-0@lo:400:kworker.0 Request processed in 56us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.518491:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784045306.518502:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784045306.518508:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873813504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518535:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873813504:12345-0@lo:400:kworker.0 Request processed in 27us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.518540:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784045306.518549:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784045306.518555:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873814016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518582:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873814016:12345-0@lo:400:kworker.0 Request processed in 28us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045306.518587:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1784045306.518641:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045306.518646:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045306.518649:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045306.518650:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045306.518692:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873812992:0@lo:400:kworker.0 00010000:00080000:2.0:1784045306.518709:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831f9880 x1870706873813504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045306.518734:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873813504:0@lo:400:kworker.0 00010000:00080000:2.0:1784045306.518747:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831fa300 x1870706873814016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045306.518755:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873814016:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518765:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873812864:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518775:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873813376:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518784:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873813888:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518845:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873813120:0@lo:400:kworker.0 00010000:00080000:2.0:1784045306.518856:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831f9c00 x1870706873813632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045306.518865:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873813632:0@lo:400:kworker.0 00010000:00080000:2.0:1784045306.518875:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831f8000 x1870706873814144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045306.518883:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873814144:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518893:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873812736:0@lo:400:kworker.0 00000100:00100000:2.0:1784045306.518904:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873813248:0@lo:400:kworker.0 00010000:00080000:2.0:1784045306.518914:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831fbb80 x1870706873813760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045306.518921:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873813760:0@lo:400:kworker.0 00010000:00080000:2.0:1784045306.518938:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831fb100 x1870706873814272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045306.518947:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873814272:0@lo:400:kworker.0 00000100:00100000:0.0:1784045306.520144:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873814400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045306.520212:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045306.520295:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873814400 00000100:00100000:1.0:1784045306.520303:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873814400 00000100:00100000:1.0:1784045306.520364:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784045306.520372:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873814400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045306.520418:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784045306.521864:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873814400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1482us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045306.521876:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784045306.528425:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873814400:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1784045306.847221:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045307.033044:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873814528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045307.033136:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045307.033208:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873814528 00000100:00100000:1.0:1784045307.033217:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873814528 00000100:00100000:1.0:1784045307.033257:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784045307.033265:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873814528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045307.033293:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045307.033336:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873814528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045307.033344:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1784045307.033389:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6927800 x1870706873814528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045307.033408:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873814528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045307.039008:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873814656:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045307.039072:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045307.039251:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873814656 00000100:00100000:3.0:1784045307.039259:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873814656 00000100:00100000:3.0:1784045307.039302:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784045307.039312:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873814656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784045307.039333:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045307.039379:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873814656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045307.039386:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1784045307.039493:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a1f80 x1870706873814656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045307.039510:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873814656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045307.076549:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045307.076627:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045307.076656:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045307.076695:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863254272 00000100:00100000:1.0:1784045307.076714:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863254272 00000100:00100000:1.0:1784045307.076768:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863254144 00000100:00100000:1.0:1784045307.076771:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863254144 00000100:00100000:1.0:1784045307.076796:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 122 00000100:00100000:1.0:1784045307.076806:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863254272:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045307.076876:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863254272:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045307.076884:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 122 00000100:00100000:1.0:1784045307.076906:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 123 00000100:00100000:1.0:1784045307.076912:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863254144:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045307.076940:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863254144:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 28us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045307.076946:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 123 00000100:00080000:1.0:1784045307.076975:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045307.076980:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045307.078809:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863254016 00000100:00100000:2.0:1784045307.078822:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863254016 00000100:00100000:2.0:1784045307.078907:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 287 00000100:00100000:2.0:1784045307.078916:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2395:x1870706863254016:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045307.078988:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2395:x1870706863254016:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 73us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045307.078995:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 287 00010000:00010000:0.0:1784045307.859838:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045308.889400:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045309.593874:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045309.593910:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873814784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045309.594027:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873814912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784045309.594035:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045309.594132:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045309.594337:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873814784 00000100:00100000:3.0:1784045309.594350:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873814784 00000100:00100000:3.0:1784045309.594428:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873814912 00000100:00100000:3.0:1784045309.594432:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873814912 00000100:00100000:3.0:1784045309.594508:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784045309.594518:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873814784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045309.594556:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045309.594718:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873814784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 200us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045309.594788:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784045309.594807:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784045309.594814:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873814912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784045309.594826:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045309.594861:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873814912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045309.594867:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1784045309.594925:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a1f80 x1870706873814784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784045309.595172:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045309.595231:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873814784:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1784045309.595308:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b823bd180 x1870706873814912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045309.595339:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873814912:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784045309.909041:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045310.101348:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873815040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045310.101439:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045310.102195:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873815040 00000100:00100000:3.0:1784045310.102213:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873815040 00000100:00100000:3.0:1784045310.102306:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784045310.102319:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873815040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045310.102370:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045310.106424:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873815040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4093us (4970us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045310.106441:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784045310.119731:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873815040:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784045310.931596:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045311.636660:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045311.636692:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873815168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045311.636794:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045311.636888:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873815168 00000100:00100000:2.0:1784045311.636897:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873815168 00000100:00100000:2.0:1784045311.636969:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784045311.636979:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873815168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784045311.637022:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784045311.637073:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873815168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045311.637082:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784045311.637132:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873815168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045311.637362:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873815552:0@lo:400:kworker.0 00000100:00100000:0.0:1784045311.637400:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045311.637427:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873816064:0@lo:400:kworker.0 00000100:00100000:0.0:1784045311.637485:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045311.637508:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873816576:0@lo:400:kworker.0 00000100:00100000:0.0:1784045311.637531:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045311.637549:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784045311.637554:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873815424:0@lo:400:kworker.0 00000100:00100000:0.0:1784045311.637596:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045311.637618:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873815936:0@lo:400:kworker.0 00000100:00100000:0.0:1784045311.637640:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045311.637658:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873816448:0@lo:400:kworker.0 00000100:00100000:0.0:1784045311.637679:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045311.637707:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873815552 00000100:00100000:0.0:1784045311.637711:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873815552 00000100:00100000:0.0:1784045311.637737:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873815424 00000100:00100000:0.0:1784045311.637739:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873815424 00000100:00100000:0.0:1784045311.637751:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873815936 00000100:00100000:0.0:1784045311.637753:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873815936 00000100:00100000:0.0:1784045311.637779:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873816448 00000100:00100000:0.0:1784045311.637782:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873816448 00000100:00100000:0.0:1784045311.637799:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784045311.637806:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873815552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045311.637858:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873815552:12345-0@lo:400:kworker.0 Request processed in 53us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045311.637864:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784045311.637877:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784045311.637881:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873815424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045311.637907:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873815424:12345-0@lo:400:kworker.0 Request processed in 25us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045311.637912:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784045311.637922:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1784045311.637927:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873815936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045311.637966:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873815936:12345-0@lo:400:kworker.0 Request processed in 38us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045311.637971:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1784045311.637982:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1784045311.637988:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873816448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045311.638010:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873816448:12345-0@lo:400:kworker.0 Request processed in 23us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045311.638016:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1784045311.638040:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045311.638067:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873815424:0@lo:400:kworker.0 00010000:00080000:0.0:1784045311.638080:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a5500 x1870706873815936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045311.638089:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873815936:0@lo:400:kworker.0 00010000:00080000:0.0:1784045311.638097:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d7800 x1870706873816448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045311.638112:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873816448:0@lo:400:kworker.0 00000100:00100000:0.0:1784045311.638124:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873815552:0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.638219:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873816064 00000100:00100000:2.0:1784045311.638224:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873816064 00000100:00100000:2.0:1784045311.638267:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873816576 00000100:00100000:2.0:1784045311.638270:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873816576 00000100:00100000:2.0:1784045311.638291:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784045311.638297:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873816064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.638341:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873816064:12345-0@lo:400:kworker.0 Request processed in 44us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045311.638348:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784045311.638359:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784045311.638364:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873816576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.638392:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873816576:12345-0@lo:400:kworker.0 Request processed in 28us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045311.638397:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784045311.638429:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873815296:0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.638493:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045311.638526:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873815808:0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.638548:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045311.638566:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873816320:0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.638587:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045311.638605:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784045311.638611:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873815680:0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.638636:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045311.638656:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873816192:0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.638676:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045311.638704:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873816704:0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.638725:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045311.638751:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873815296 00000100:00100000:2.0:1784045311.638754:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873815296 00000100:00100000:2.0:1784045311.638784:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1784045311.638790:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873815296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.638825:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873815296:12345-0@lo:400:kworker.0 Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045311.638831:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1784045311.638859:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873815680 00000100:00100000:2.0:1784045311.638863:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873815680 00000100:00100000:2.0:1784045311.638886:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784045311.638892:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873815680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.638922:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873815680:12345-0@lo:400:kworker.0 Request processed in 30us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045311.638927:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784045311.638955:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873816192 00000100:00100000:2.0:1784045311.638959:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873816192 00000100:00100000:2.0:1784045311.638980:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873816704 00000100:00100000:2.0:1784045311.638983:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873816704 00000100:00100000:2.0:1784045311.638999:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784045311.639004:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873816192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.639034:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873816192:12345-0@lo:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045311.639039:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784045311.639050:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784045311.639055:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873816704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.639091:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873816704:12345-0@lo:400:kworker.0 Request processed in 36us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045311.639097:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784045311.639120:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873815808 00000100:00100000:2.0:1784045311.639123:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873815808 00000100:00100000:2.0:1784045311.639146:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873816320 00000100:00100000:2.0:1784045311.639149:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873816320 00000100:00100000:2.0:1784045311.639163:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784045311.639168:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873815808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.639197:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873815808:12345-0@lo:400:kworker.0 Request processed in 29us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045311.639203:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784045311.639213:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784045311.639219:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873816320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.639243:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873816320:12345-0@lo:400:kworker.0 Request processed in 25us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045311.639248:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:2.0:1784045311.639295:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a4700 x1870706873816064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045311.639307:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873816064:0@lo:400:kworker.0 00010000:00080000:2.0:1784045311.639325:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d6680 x1870706873816576/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045311.639334:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873816576:0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.639366:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873815680:0@lo:400:kworker.0 00010000:00080000:2.0:1784045311.639375:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a6300 x1870706873816192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045311.639389:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873816192:0@lo:400:kworker.0 00010000:00080000:2.0:1784045311.639400:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d6a00 x1870706873816704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045311.639407:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873816704:0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.639416:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873815296:0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.639426:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873815808:0@lo:400:kworker.0 00000100:00100000:2.0:1784045311.639434:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873816320:0@lo:400:kworker.0 00000100:00080000:0.0:1784045311.639711:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045311.639717:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045311.639720:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784045311.958314:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045312.150685:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873816832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045312.150789:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045312.150908:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873816832 00000100:00100000:1.0:1784045312.150917:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873816832 00000100:00100000:1.0:1784045312.150986:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784045312.150997:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873816832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045312.151036:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045312.151088:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873816832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045312.151096:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1784045312.151164:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833ed500 x1870706873816832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045312.151185:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873816832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045312.155101:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045312.155132:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873816960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045312.155223:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045312.159475:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873816960 00000100:00100000:2.0:1784045312.159499:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873816960 00000100:00100000:2.0:1784045312.159580:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784045312.159593:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873816960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784045312.159629:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045312.159751:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873816960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (4528us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045312.159760:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1784045312.159952:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83578a80 x1870706873816960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045312.159979:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873816960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045312.196115:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045312.196172:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045312.196208:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045312.196245:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863254656 00000100:00100000:1.0:1784045312.196258:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863254656 00000100:00100000:1.0:1784045312.196326:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863254528 00000100:00100000:1.0:1784045312.196329:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863254528 00000100:00100000:1.0:1784045312.196354:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 130 00000100:00100000:1.0:1784045312.196364:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863254656:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045312.196487:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863254656:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 123us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045312.196496:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 130 00000100:00100000:1.0:1784045312.196525:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 131 00000100:00100000:1.0:1784045312.196532:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863254528:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045312.196561:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863254528:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 30us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045312.196568:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 131 00000100:00100000:0.0:1784045312.196829:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863254400 00000100:00100000:0.0:1784045312.196834:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863254400 00000100:00100000:0.0:1784045312.196880:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 289 00000100:00100000:0.0:1784045312.196888:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2394:x1870706863254400:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045312.196922:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2394:x1870706863254400:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 36us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045312.196929:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 289 00000100:00080000:0.0:1784045312.196973:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045312.196978:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1784045312.979661:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045314.003798:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045314.708427:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873817088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784045314.708567:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045314.708899:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873817088 00000100:00100000:1.0:1784045314.708909:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873817088 00000100:00100000:1.0:1784045314.709000:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784045314.709012:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873817088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045314.709057:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045314.709059:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873817216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045314.709095:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045314.709111:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873817088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045314.709134:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784045314.709161:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873817216 00000100:00100000:1.0:1784045314.709165:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873817216 00000100:00100000:1.0:1784045314.709183:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784045314.709188:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873817216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045314.709199:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045314.709236:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873817216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045314.709242:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1784045314.709295:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a1f80 x1870706873817088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1784045314.709298:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83578a80 x1870706873817216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045314.709315:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83578a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873817216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045314.709315:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873817088:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784045314.710081:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784045315.031891:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045315.224682:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045315.224713:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873817344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045315.224812:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045315.224891:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873817344 00000100:00100000:2.0:1784045315.224900:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873817344 00000100:00100000:2.0:1784045315.224976:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784045315.224986:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873817344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784045315.225029:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784045315.225093:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873817344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045315.225100:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784045315.225157:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873817344:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1784045315.373302:0:11974:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:08:32 (1784045312) === 00000100:00100000:2.0:1784045315.870637:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045315.870712:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863254784 00000100:00100000:3.0:1784045315.870721:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863254784 00000100:00100000:3.0:1784045315.870766:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 290 00000100:00100000:3.0:1784045315.870775:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:8723:x1870706863254784:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784045315.870789:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045315.870806:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc2171c00/0x5475624df454c6b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73edd5 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045315.870851:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc2171c00/0x5475624df454c6b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edd5 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045315.870861:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc2171c00/0x5475624df454c6b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edd5 expref: 11 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045315.870870:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171c00, rc 0) 00000100:00100000:3.0:1784045315.870944:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:8723:x1870706863254784:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 171us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045315.870951:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 290 00000100:00100000:3.0:1784045315.875337:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045315.875493:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863254912 00000100:00100000:1.0:1784045315.875503:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863254912 00000100:00100000:1.0:1784045315.875561:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 291 00000100:00100000:1.0:1784045315.875571:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:8723:x1870706863254912:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784045315.875723:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:8723:x1870706863254912:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 153us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045315.875731:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 291 00000100:00100000:2.0:1784045315.881298:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045315.881498:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863255040 00000100:00100000:0.0:1784045315.881520:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863255040 00000100:00100000:0.0:1784045315.881567:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 292 00000100:00100000:0.0:1784045315.881577:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:8723:x1870706863255040:12345-192.168.203.44@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784045315.881733:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:8723:x1870706863255040:12345-192.168.203.44@tcp:503:mount.lustre.0 Request processed in 158us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045315.881741:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 292 00000100:00100000:2.0:1784045315.900508:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045315.900791:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863255168 00000100:00100000:3.0:1784045315.900800:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863255168 00000100:00100000:3.0:1784045315.900855:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 293 00000100:00100000:3.0:1784045315.900865:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:8727:x1870706863255168:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784045315.901033:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:8727:x1870706863255168:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 169us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045315.901042:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 293 00000100:00100000:3.0:1784045315.932320:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045315.932475:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863255296 00000100:00100000:1.0:1784045315.932485:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863255296 00000100:00100000:1.0:1784045315.932544:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 294 00000100:00100000:1.0:1784045315.932554:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:8727:x1870706863255296:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784045315.932855:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:8727:x1870706863255296:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 300us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045315.932886:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 294 00000100:00100000:2.0:1784045315.939092:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045315.939334:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863255424 00000100:00100000:0.0:1784045315.939348:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863255424 00000100:00100000:0.0:1784045315.939423:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 295 00000100:00100000:0.0:1784045315.939435:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:8727:x1870706863255424:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784045315.939665:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:8727:x1870706863255424:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 232us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045315.939674:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 295 00000100:00100000:2.0:1784045315.949009:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045315.949132:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863255552 00000100:00100000:1.0:1784045315.949146:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863255552 00000100:00100000:1.0:1784045315.949225:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 296 00000100:00100000:1.0:1784045315.949238:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:8723:x1870706863255552:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784045315.949260:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045315.949283:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc106e800/0x5475624df454c6bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73ee06 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045315.949323:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106e800/0x5475624df454c6bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee06 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045315.949336:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc106e800/0x5475624df454c6bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee06 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045315.949347:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106e800, rc 0) 00000100:00100000:1.0:1784045315.949426:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:8723:x1870706863255552:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 191us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045315.949435:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 296 00000100:00100000:3.0:1784045315.962430:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045315.963850:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863255680 00000100:00100000:2.0:1784045315.963870:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863255680 00000100:00100000:2.0:1784045315.963965:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 297 00000100:00100000:2.0:1784045315.963978:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:8723:x1870706863255680:12345-192.168.203.44@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784045315.964015:0:6488:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784045315.964048:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784045315.964053:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784045315.964056:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784045315.964059:0:6488:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784045315.964061:0:6488:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1784045315.969252:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:8723:x1870706863255680:12345-192.168.203.44@tcp:256:mount.lustre.0 Request processed in 5259us (6820us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045315.969271:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 297 00000100:00100000:3.0:1784045315.977663:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045315.984827:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863255808 00000100:00100000:0.0:1784045315.984850:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863255808 00000100:00100000:0.0:1784045315.984951:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 298 00000100:00100000:0.0:1784045315.984964:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:8723:x1870706863255808:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784045315.984988:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045315.985015:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915aaa00/0x5475624df454c6c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73ee0d expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.985054:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915aaa00/0x5475624df454c6c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee0d expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.985092:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915aaa00/0x5475624df454c6c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee0d expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045315.985102:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aaa00, rc 0) 00000100:00100000:0.0:1784045315.985264:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:8723:x1870706863255808:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 301us (7615us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045315.985272:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 298 00000100:00100000:3.0:1784045315.992000:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045315.992162:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863255936 00000100:00100000:0.0:1784045315.992175:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863255936 00000100:00100000:0.0:1784045315.992247:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 299 00000100:00100000:0.0:1784045315.992259:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:8723:x1870706863255936:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784045315.995059:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:8723:x1870706863255936:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 2515us (2795us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045315.995079:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 299 00000100:00100000:2.0:1784045315.996724:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045315.996919:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863256064 00000100:00100000:1.0:1784045315.996931:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863256064 00000100:00100000:1.0:1784045315.997035:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 300 00000100:00100000:1.0:1784045315.997046:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:8723:x1870706863256064:12345-192.168.203.44@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784045315.997744:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:8723:x1870706863256064:12345-192.168.203.44@tcp:503:mount.lustre.0 Request processed in 694us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045315.997755:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 300 00000100:00100000:3.0:1784045316.000273:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045316.000429:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863256192 00000100:00100000:0.0:1784045316.000485:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863256192 00000100:00100000:1.0:1784045316.002148:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 301 00000100:00100000:1.0:1784045316.002163:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:8731:x1870706863256192:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784045316.002736:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:8731:x1870706863256192:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 573us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.002746:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 301 00000100:00100000:2.0:1784045316.021053:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045316.021366:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863256320 00000100:00100000:1.0:1784045316.021379:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863256320 00000100:00100000:1.0:1784045316.021480:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 302 00000100:00100000:1.0:1784045316.021880:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:8731:x1870706863256320:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784045316.022105:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:8731:x1870706863256320:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 614us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.022114:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 302 00000100:00100000:2.0:1784045316.033865:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045316.038852:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863256448 00000100:00100000:1.0:1784045316.038874:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863256448 00000100:00100000:1.0:1784045316.038961:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:1.0:1784045316.038972:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1870706863256448:12345-192.168.203.44@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784045316.039012:0:6496:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from e3b4a878-6779-48a0-8f76-90916f645fbb@192.168.203.44@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:1.0:1784045316.039058:0:6496:0:(genops.c:1406:class_connect()) connect: client e3b4a878-6779-48a0-8f76-90916f645fbb, cookie 0x5475624df454c6c9 00000004:00100000:1.0:1784045316.039090:0:6496:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1784045316.039246:0:6496:0:(import.c:65:import_set_state_nolock()) ffff939cb6872800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045316.040038:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045316.040081:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045316.040106:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045316.040131:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863256704 00000100:00100000:2.0:1784045316.040136:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863256704 00000100:00100000:2.0:1784045316.040165:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863257088 00000100:00100000:2.0:1784045316.040186:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863257088 00000100:00100000:2.0:1784045316.040223:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863257216 00000100:00100000:2.0:1784045316.040226:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863257216 00000100:00100000:2.0:1784045316.040242:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 132 00000100:00100000:2.0:1784045316.040251:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863257088:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045316.040326:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863257088:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 75us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045316.040334:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 132 00000100:00100000:2.0:1784045316.040353:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 133 00000100:00100000:2.0:1784045316.040360:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863257216:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045316.040399:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863257216:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 39us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045316.040406:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 133 00000100:00100000:2.0:1784045316.040418:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:2.0:1784045316.040423:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1870706863256704:12345-192.168.203.44@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784045316.040480:0:6498:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from e3b4a878-6779-48a0-8f76-90916f645fbb@192.168.203.44@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:2.0:1784045316.040511:0:6498:0:(genops.c:1406:class_connect()) connect: client e3b4a878-6779-48a0-8f76-90916f645fbb, cookie 0x5475624df454c6d0 00000004:00100000:2.0:1784045316.040533:0:6498:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:2.0:1784045316.040647:0:6498:0:(import.c:65:import_set_state_nolock()) ffff939cb7b89000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045316.040677:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2393:x1870706863256704:12345-192.168.203.44@tcp:38:mount.lustre.0 Request processed in 252us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045316.040684:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:1.0:1784045316.040802:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2393:x1870706863256448:12345-192.168.203.44@tcp:38:mount.lustre.0 Request processed in 1818us (6938us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.040818:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00080000:0.0:1784045316.041129:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784045316.041135:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045316.045330:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045316.045385:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045316.045565:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863256832 00000100:00100000:0.0:1784045316.045685:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863256832 00000100:00100000:3.0:1784045316.045699:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863256576 00000100:00100000:3.0:1784045316.045707:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863256576 00000100:00080000:1.0:1784045316.045783:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045316.045798:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784045316.045801:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:3.0:1784045316.045838:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+6:0:x1870706863256576:12345-192.168.203.44@tcp:41:mount.lustre.0 00000100:00100000:0.0:1784045316.045931:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:0.0:1784045316.045941:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+6:0:x1870706863256832:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784045316.045979:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000004:00000024:3.0:1784045316.045994:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784045316.046102:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+6:0:x1870706863256832:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 161us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045316.046103:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+6:0:x1870706863256576:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 268us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045316.046118:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:3.0:1784045316.046350:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00010000:00010000:0.0:1784045316.052432:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045316.053140:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045316.053250:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863256960 00000100:00100000:1.0:1784045316.053265:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863256960 00000100:00100000:1.0:1784045316.053343:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:1.0:1784045316.053353:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+6:8723:x1870706863256960:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784045316.053386:0:6496:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784045316.053567:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+6:8723:x1870706863256960:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 214us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.053575:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:2.0:1784045316.058053:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045316.058228:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863257344 00000100:00100000:0.0:1784045316.058241:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863257344 00000100:00100000:0.0:1784045316.058749:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:0.0:1784045316.058763:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+6:8723:x1870706863257344:12345-192.168.203.44@tcp:40:mount.lustre.0 00000100:00100000:0.0:1784045316.058883:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+6:8723:x1870706863257344:12345-192.168.203.44@tcp:40:mount.lustre.0 Request processed in 123us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045316.058892:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:2.0:1784045316.062578:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045316.062629:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045316.062688:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045316.062789:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863257472 00000100:00100000:3.0:1784045316.062802:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863257472 00000100:00100000:1.0:1784045316.062821:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863257728 00000100:00100000:1.0:1784045316.062828:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863257728 00000100:00100000:3.0:1784045316.062856:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863257600 00000100:00100000:3.0:1784045316.062861:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863257600 00000100:00100000:1.0:1784045316.062885:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:3.0:1784045316.062889:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:3.0:1784045316.062900:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2393:x1870706863257472:12345-192.168.203.44@tcp:8:mount.lustre.0 00000100:00100000:1.0:1784045316.062901:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e3b4a878-6779-48a0-8f76-90916f645fbb+6:8723:x1870706863257728:12345-192.168.203.44@tcp:900:mount.lustre.0 00010000:00080000:3.0:1784045316.062955:0:9935:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from e3b4a878-6779-48a0-8f76-90916f645fbb@192.168.203.44@tcp t0 exp 0000000000000000 cur 272 last 0 00000100:00100000:1.0:1784045316.063011:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e3b4a878-6779-48a0-8f76-90916f645fbb+6:8723:x1870706863257728:12345-192.168.203.44@tcp:900:mount.lustre.0 Request processed in 113us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.063020:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:2.0:1784045316.063200:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:2.0:1784045316.063206:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1870706863257600:12345-192.168.203.44@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784045316.063227:0:8413:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from e3b4a878-6779-48a0-8f76-90916f645fbb@192.168.203.44@tcp t0 exp 0000000000000000 cur 272 last 0 00000020:00000080:2.0:1784045316.063259:0:8413:0:(genops.c:1406:class_connect()) connect: client e3b4a878-6779-48a0-8f76-90916f645fbb, cookie 0x5475624df454c6de 00002000:00100000:2.0:1784045316.063274:0:8413:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e3b4a878-6779-48a0-8f76-90916f645fbb/ffff939cb7b8d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784045316.063298:0:8413:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1784045316.063390:0:8413:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784045316.063425:0:8413:0:(import.c:65:import_set_state_nolock()) ffff939cb7b8f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045316.063501:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2393:x1870706863257600:12345-192.168.203.44@tcp:8:mount.lustre.0 Request processed in 294us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045316.063509:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000020:00000080:1.0:1784045316.064075:0:9935:0:(genops.c:1406:class_connect()) connect: client e3b4a878-6779-48a0-8f76-90916f645fbb, cookie 0x5475624df454c6d7 00002000:00100000:1.0:1784045316.064085:0:9935:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e3b4a878-6779-48a0-8f76-90916f645fbb/ffff939b82a19800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784045316.064099:0:9935:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1784045316.064159:0:9935:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784045316.064181:0:9935:0:(import.c:65:import_set_state_nolock()) ffff939cb6874000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784045316.064235:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2393:x1870706863257472:12345-192.168.203.44@tcp:8:mount.lustre.0 Request processed in 1336us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.064244:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:2.0:1784045316.071875:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045316.072007:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863257856 00000100:00100000:1.0:1784045316.072020:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863257856 00000100:00100000:1.0:1784045316.072098:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:1.0:1784045316.072129:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+6:8723:x1870706863257856:12345-192.168.203.44@tcp:33:mount.lustre.0 00000004:00200000:1.0:1784045316.072251:0:6499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1784045316.073944:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+6:8723:x1870706863257856:12345-192.168.203.44@tcp:33:mount.lustre.0 Request processed in 1805us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.073959:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:1.0:1784045316.755708:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045316.755862:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045316.755964:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8357b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873817600:0@lo:400:kworker.0 00000100:00100000:3.0:1784045316.756032:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045316.756140:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873817600 00000100:00100000:2.0:1784045316.756149:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873817600 00000100:00100000:2.0:1784045316.756392:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1784045316.756401:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873817600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045316.756481:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873817600:12345-0@lo:400:kworker.0 Request processed in 80us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045316.756488:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1784045316.756533:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8357b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873817600:0@lo:400:kworker.0 00000100:00100000:0.0:1784045316.759346:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045316.759375:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873817728:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.759382:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873817472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045316.759537:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045316.759620:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045316.759634:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873817472 00000100:00100000:0.0:1784045316.759653:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873817856:0@lo:400:kworker.0 00000100:00100000:2.0:1784045316.759656:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873817472 00000100:00100000:1.0:1784045316.759656:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045316.759666:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873817984:0@lo:400:kworker.0 00000100:00100000:0.0:1784045316.759681:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045316.759690:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045316.759717:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873817856 00000100:00100000:1.0:1784045316.759719:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873817728 00000100:00100000:2.0:1784045316.759721:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873817856 00000100:00100000:1.0:1784045316.759726:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873817728 00000100:00100000:0.0:1784045316.759726:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784045316.759739:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3626:x1870706873817472:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045316.759743:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784045316.759755:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1870706873817856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.759766:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873817984 00000004:00000024:0.0:1784045316.759777:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784045316.759778:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873817984 00000100:00100000:1.0:1784045316.759802:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784045316.759808:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873817728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045316.759826:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3626:x1870706873817472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045316.759834:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784045316.759839:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873817728:12345-0@lo:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.759844:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784045316.759859:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784045316.759866:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873817984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045316.759901:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873817984:12345-0@lo:400:kworker.0 Request processed in 36us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.760108:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873818112:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.760136:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045316.760153:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873818624:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.760176:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045316.760194:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873819136:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.760234:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045316.760292:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873817984:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.760308:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873817472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045316.760343:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784045316.760349:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873818496:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.760373:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045316.760391:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873819008:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.760411:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045316.760477:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873818112 00000100:00100000:1.0:1784045316.760482:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873818112 00000100:00100000:1.0:1784045316.760504:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784045316.760510:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873818112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.760547:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873818112:12345-0@lo:400:kworker.0 Request processed in 36us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.760553:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784045316.760576:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873818368:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.760601:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045316.760616:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873818880:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.760637:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045316.760663:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873817728:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.760675:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784045316.760681:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873818240:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.760703:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045316.760714:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873818752:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.760734:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045316.760763:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873818112:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.760777:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873818368 00000100:00100000:1.0:1784045316.760779:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873818368 00000100:00100000:1.0:1784045316.760805:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873818880 00000100:00100000:1.0:1784045316.760807:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873818880 00000100:00100000:1.0:1784045316.760818:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873818240 00000100:00100000:1.0:1784045316.760820:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873818240 00000100:00100000:1.0:1784045316.760829:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873818752 00000100:00100000:1.0:1784045316.760831:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873818752 00000100:00100000:1.0:1784045316.760842:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784045316.760847:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873818368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.761055:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873818368:12345-0@lo:400:kworker.0 Request processed in 205us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.761063:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784045316.761082:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784045316.761088:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873818880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.761114:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873818880:12345-0@lo:400:kworker.0 Request processed in 27us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.761119:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784045316.761130:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784045316.761135:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873818240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.761157:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873818240:12345-0@lo:400:kworker.0 Request processed in 22us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.761162:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784045316.761173:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784045316.761180:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873818752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.761211:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873818752:12345-0@lo:400:kworker.0 Request processed in 34us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.761226:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1784045316.761244:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045316.761248:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784045316.761271:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873818240:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.761284:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873818752:0@lo:400:kworker.0 00010000:00080000:1.0:1784045316.761296:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833ee300 x1870706873818368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045316.761308:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873818368:0@lo:400:kworker.0 00010000:00080000:1.0:1784045316.761373:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833ed180 x1870706873818880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045316.761384:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873818880:0@lo:400:kworker.0 00000100:00100000:1.0:1784045316.761423:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873817856:0@lo:400:kworker.0 00000100:00100000:0.0:1784045316.761481:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784045316.761482:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873818624 00000100:00100000:1.0:1784045316.761486:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873818624 00000100:00080000:0.0:1784045316.761512:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045316.761526:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873819136 00000100:00100000:1.0:1784045316.761529:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873819136 00000100:00100000:1.0:1784045316.761551:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873819008 00000100:00100000:0.0:1784045316.761551:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873818496 00000100:00100000:1.0:1784045316.761554:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873819008 00000100:00100000:0.0:1784045316.761560:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873818496 00000100:00100000:1.0:1784045316.761567:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784045316.761572:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873818624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045316.761583:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784045316.761588:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873819136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045316.767062:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873817856:12345-0@lo:400:kworker.0 Request processed in 7295us (7366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045316.767082:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784045316.767123:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873818624:12345-0@lo:400:kworker.0 Request processed in 5544us (6941us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045316.767126:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873819136:12345-0@lo:400:kworker.0 Request processed in 5533us (6886us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045316.767146:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784045316.767153:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1784045316.767220:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833ef100 x1870706873818624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045316.767256:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873818624:0@lo:400:kworker.0 00010000:00080000:1.0:1784045316.767287:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833ec380 x1870706873819136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045316.767298:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873819136:0@lo:400:kworker.0 00000100:00100000:2.0:1784045316.767583:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784045316.767604:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784045316.767605:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873819008:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784045316.767644:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045316.767653:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784045316.767673:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873818496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045316.767687:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873819008:12345-0@lo:400:kworker.0 Request processed in 91us (7273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045316.767695:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784045316.767729:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873818496:12345-0@lo:400:kworker.0 Request processed in 111us (7353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045316.767738:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1784045316.767742:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833ec000 x1870706873818496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045316.767757:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873818496:0@lo:400:kworker.0 00010000:00080000:2.0:1784045316.768278:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833ece00 x1870706873819008/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045316.768292:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873819008:0@lo:400:kworker.0 00010000:00010000:0.0:1784045317.075606:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045317.269538:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873819264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045317.269618:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045317.269771:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873819264 00000100:00100000:0.0:1784045317.269837:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873819264 00000100:00100000:0.0:1784045317.269890:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784045317.269909:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873819264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784045317.269932:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045317.270044:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873819264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 146us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045317.270052:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1784045317.270104:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b8357a680 x1870706873819264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045317.270127:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873819264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045317.271426:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc10f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873819392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045317.271506:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045317.271555:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873819392 00000100:00100000:1.0:1784045317.271561:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873819392 00000100:00100000:1.0:1784045317.271672:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784045317.271681:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873819392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045317.271701:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045317.271739:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873819392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045317.271746:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1784045317.275744:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc10f9500 x1870706873819392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045317.275771:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc10f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873819392:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784045318.100599:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045319.131876:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045319.828031:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873819520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045319.828135:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045319.828356:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873819520 00000100:00100000:3.0:1784045319.828376:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873819520 00000100:00080000:1.0:1784045319.828434:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045319.828493:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784045319.828506:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873819520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784045319.828544:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045319.828600:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873819520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045319.828605:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1784045319.828872:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a2a00 x1870706873819520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045319.828904:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873819520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784045319.829125:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873819648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045319.829183:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045319.829539:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873819648 00000100:00100000:2.0:1784045319.829545:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873819648 00000100:00100000:2.0:1784045319.829625:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784045319.829633:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873819648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045319.829657:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045319.829750:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873819648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045319.829765:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1784045319.829951:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784045319.829991:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b8357a680 x1870706873819648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045319.830007:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873819648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784045320.147648:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045320.340004:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045320.340041:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873819776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784045320.340115:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045320.340209:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873819776 00000100:00100000:0.0:1784045320.340226:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873819776 00000100:00100000:0.0:1784045320.340313:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784045320.340325:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873819776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045320.340383:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045320.340502:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873819776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 180us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045320.340510:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784045320.341048:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873819776:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784045321.171818:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045321.409947:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045321.410000:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045321.410047:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045321.410085:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045321.410111:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045321.410131:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045321.410174:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045321.410206:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863258752 00000100:00100000:2.0:1784045321.410217:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863258752 00000100:00100000:2.0:1784045321.410285:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863258624 00000100:00100000:2.0:1784045321.410288:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863258624 00000100:00100000:2.0:1784045321.410315:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:2.0:1784045321.410327:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2395:x1870706863258752:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045321.410421:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2395:x1870706863258752:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 96us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045321.410431:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:2.0:1784045321.410502:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:2.0:1784045321.410511:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2395:x1870706863258624:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045321.410537:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2395:x1870706863258624:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045321.410544:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:2.0:1784045321.410564:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863258240 00000100:00100000:2.0:1784045321.410585:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863258240 00000100:00100000:2.0:1784045321.410623:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863258496 00000100:00100000:2.0:1784045321.410626:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863258496 00000100:00100000:2.0:1784045321.410638:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863258112 00000100:00100000:2.0:1784045321.410641:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863258112 00000100:00100000:2.0:1784045321.410653:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863258368 00000100:00100000:2.0:1784045321.410656:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863258368 00000100:00100000:2.0:1784045321.410670:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 140 00000100:00100000:2.0:1784045321.410676:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863258240:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045321.410706:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863258240:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 30us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045321.410713:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 140 00000100:00100000:2.0:1784045321.410725:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 141 00000100:00100000:2.0:1784045321.410732:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2395:x1870706863258496:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045321.410757:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2395:x1870706863258496:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045321.410763:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 141 00000100:00100000:2.0:1784045321.410775:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 142 00000100:00100000:2.0:1784045321.410781:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863258112:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045321.410806:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863258112:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 25us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045321.410813:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 142 00000100:00100000:2.0:1784045321.410824:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 143 00000100:00100000:2.0:1784045321.410830:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2395:x1870706863258368:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045321.410855:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2395:x1870706863258368:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045321.410868:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 143 00000100:00100000:1.0:1784045321.411109:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863257984 00000100:00100000:1.0:1784045321.411126:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863257984 00000100:00080000:0.0:1784045321.411171:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045321.411178:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784045321.411181:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045321.411183:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045321.411207:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 304 00000100:00100000:1.0:1784045321.411219:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863257984:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045321.411312:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863257984:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 95us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045321.411320:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 304 00000100:00100000:1.0:1784045321.875830:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045321.875852:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc10f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873819904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045321.875932:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045321.876014:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873819904 00000100:00100000:1.0:1784045321.876022:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873819904 00000100:00100000:1.0:1784045321.876068:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784045321.876077:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873819904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045321.876111:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784045321.876167:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873819904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045321.876175:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784045321.876240:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc10f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873819904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045321.876773:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873820416:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.876812:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.876834:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873820928:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.876856:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.876883:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873821440:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.876904:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.876931:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784045321.876938:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873820288:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.876960:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.876979:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873820800:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.877338:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.877362:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873821312:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.877388:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.877418:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873820160:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.877480:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.877502:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873820672:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.877524:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.877554:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873821184:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.877574:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.877594:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1784045321.877667:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873820032:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.877698:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.877723:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873820544:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.877744:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.877756:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873821056:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.877776:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045321.877798:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873820416 00000100:00100000:3.0:1784045321.877804:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873820416 00000100:00100000:3.0:1784045321.877842:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784045321.877850:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8850e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873820416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.877918:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8850e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873820416:12345-0@lo:400:kworker.0 Request processed in 68us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045321.877924:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784045321.878845:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873820288 00000100:00100000:0.0:1784045321.878852:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873820288 00000100:00100000:0.0:1784045321.878890:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873820160 00000100:00100000:0.0:1784045321.878894:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873820160 00000100:00100000:0.0:1784045321.878906:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873820672 00000100:00100000:0.0:1784045321.878909:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873820672 00000100:00100000:0.0:1784045321.878932:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873821184 00000100:00100000:0.0:1784045321.878936:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873821184 00000100:00100000:0.0:1784045321.878948:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873820544 00000100:00100000:0.0:1784045321.878950:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873820544 00000100:00100000:0.0:1784045321.878961:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873821056 00000100:00100000:0.0:1784045321.878964:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873821056 00000100:00100000:0.0:1784045321.879029:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784045321.879037:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873820288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045321.879102:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873820288:12345-0@lo:400:kworker.0 Request processed in 66us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045321.879109:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784045321.879124:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784045321.879130:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8364a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873820160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045321.879162:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8364a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873820160:12345-0@lo:400:kworker.0 Request processed in 32us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045321.879168:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784045321.879178:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784045321.879184:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8364a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873820672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045321.879209:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8364a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873820672:12345-0@lo:400:kworker.0 Request processed in 27us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045321.879214:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784045321.879225:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784045321.879231:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873821184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045321.879256:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873821184:12345-0@lo:400:kworker.0 Request processed in 26us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045321.879262:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784045321.879272:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784045321.879278:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8364b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873820544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045321.879303:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8364b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873820544:12345-0@lo:400:kworker.0 Request processed in 26us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045321.879309:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784045321.879823:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784045321.879836:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873821056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045321.879896:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873821056:12345-0@lo:400:kworker.0 Request processed in 63us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045321.879902:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784045321.879932:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873820928 00000100:00100000:0.0:1784045321.879936:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873820928 00000100:00100000:0.0:1784045321.879962:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873821440 00000100:00100000:0.0:1784045321.879966:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873821440 00000100:00100000:0.0:1784045321.879979:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873820800 00000100:00100000:0.0:1784045321.879981:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873820800 00000100:00100000:0.0:1784045321.879991:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873821312 00000100:00100000:0.0:1784045321.879994:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873821312 00000100:00100000:3.0:1784045321.880267:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873820032 00000100:00100000:3.0:1784045321.880271:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873820032 00000100:00100000:3.0:1784045321.880301:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1784045321.880308:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873820032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.880343:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873820032:12345-0@lo:400:kworker.0 Request processed in 36us (2644us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045321.880349:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1784045321.880509:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873820032:0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.880524:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873820544:0@lo:400:kworker.0 00000100:00100000:0.0:1784045321.881116:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784045321.881124:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873820928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045321.881288:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784045321.881297:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873821440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045321.881366:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873821056:0@lo:400:kworker.0 00000100:00100000:0.0:1784045321.884390:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873820928:12345-0@lo:400:kworker.0 Request processed in 3256us (7522us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045321.884405:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784045321.884440:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784045321.884468:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873820800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045321.884516:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873820800:12345-0@lo:400:kworker.0 Request processed in 55us (7515us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045321.884523:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784045321.884547:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784045321.884555:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873821312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045321.884583:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873821312:12345-0@lo:400:kworker.0 Request processed in 30us (7195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045321.884589:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1784045321.884751:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045321.884768:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045321.884777:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045321.884780:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045321.885180:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873820288:0@lo:400:kworker.0 00010000:00080000:0.0:1784045321.885197:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb684b800 x1870706873820800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045321.885208:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873820800:0@lo:400:kworker.0 00010000:00080000:0.0:1784045321.885221:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8d880 x1870706873821312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045321.885230:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873821312:0@lo:400:kworker.0 00000100:00100000:0.0:1784045321.885242:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873820416:0@lo:400:kworker.0 00010000:00080000:0.0:1784045321.885252:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6848700 x1870706873820928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045321.885261:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873820928:0@lo:400:kworker.0 00000100:00100000:1.0:1784045321.887544:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873821440:12345-0@lo:400:kworker.0 Request processed in 6229us (10619us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045321.887559:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1784045321.887640:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8c380 x1870706873821440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045321.887654:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873821440:0@lo:400:kworker.0 00000001:00100000:2.0:1784045321.891919:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e3b4a878-6779-48a0-8f76-90916f645fbb 00000100:00100000:3.0:1784045321.896414:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873820160:0@lo:400:kworker.0 00010000:00080000:3.0:1784045321.896475:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb684ad80 x1870706873820672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045321.896486:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873820672:0@lo:400:kworker.0 00010000:00080000:3.0:1784045321.896499:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8fb80 x1870706873821184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045321.896507:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873821184:0@lo:400:kworker.0 00000001:00100000:1.0:1784045321.896935:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e3b4a878-6779-48a0-8f76-90916f645fbb 00000001:00100000:3.0:1784045321.897158:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e3b4a878-6779-48a0-8f76-90916f645fbb 00000001:00100000:2.0:1784045321.897543:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e3b4a878-6779-48a0-8f76-90916f645fbb 00010000:00010000:1.0:1784045322.195627:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045322.387646:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc10f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873821568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045322.387722:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045322.387995:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873821568 00000100:00100000:2.0:1784045322.388004:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873821568 00000100:00100000:2.0:1784045322.388054:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784045322.388063:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873821568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045322.388093:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045322.388157:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873821568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045322.388164:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1784045322.388407:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc10f8a80 x1870706873821568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045322.388426:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc10f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873821568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045322.396924:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873821696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045322.396986:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045322.397044:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873821696 00000100:00100000:3.0:1784045322.397051:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873821696 00000100:00100000:3.0:1784045322.397093:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784045322.397103:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873821696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784045322.397124:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045322.397167:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873821696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045322.397175:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1784045322.397225:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83649180 x1870706873821696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045322.397243:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873821696:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1784045322.775817:0:12167:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1784045323.221111:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045324.243622:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045324.948250:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873821824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045324.948337:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045324.948479:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873821824 00000100:00100000:0.0:1784045324.948488:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873821824 00000100:00100000:0.0:1784045324.948546:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784045324.948566:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873821824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784045324.948596:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045324.948642:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873821824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045324.948650:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1784045324.949041:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784045324.949074:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b8357a680 x1870706873821824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045324.949093:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8357a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873821824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045324.953771:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873821952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045324.953840:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045324.953962:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873821952 00000100:00100000:3.0:1784045324.953980:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873821952 00000100:00100000:3.0:1784045324.954050:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784045324.954059:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873821952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784045324.954080:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045324.954127:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873821952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045324.954134:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1784045324.954169:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83649180 x1870706873821952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045324.954187:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873821952:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784045324.954304:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784045325.269070:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045325.467460:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045325.467497:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873822080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045325.467833:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045325.468061:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873822080 00000100:00100000:2.0:1784045325.468069:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873822080 00000100:00100000:2.0:1784045325.468129:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784045325.468137:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873822080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784045325.468171:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784045325.468230:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873822080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045325.468237:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784045325.468399:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873822080:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784045326.292577:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045326.531705:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045326.531779:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045326.533567:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045326.533739:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045326.533771:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045326.533832:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863259008 00000100:00100000:0.0:1784045326.533851:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863259008 00000100:00100000:0.0:1784045326.533908:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863259264 00000100:00100000:0.0:1784045326.533911:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863259264 00000100:00100000:0.0:1784045326.533934:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 150 00000100:00100000:0.0:1784045326.533943:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2397:x1870706863259008:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045326.534435:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 151 00000100:00100000:3.0:1784045326.534463:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863259264:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045326.534535:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863259264:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 92us (2756us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045326.534542:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 151 00000100:00100000:3.0:1784045326.534586:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863258880 00000100:00100000:3.0:1784045326.534590:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863258880 00000100:00100000:0.0:1784045326.534712:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2397:x1870706863259008:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 769us (3015us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045326.534719:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 150 00000100:00080000:0.0:1784045326.534738:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045326.534839:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 306 00000100:00100000:3.0:1784045326.534857:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2397:x1870706863258880:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045326.534885:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2397:x1870706863258880:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 31us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045326.534890:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 306 00000100:00100000:3.0:1784045326.534921:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863259520 00000100:00100000:3.0:1784045326.534931:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863259520 00000100:00100000:3.0:1784045326.534980:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 75 00000100:00100000:3.0:1784045326.534987:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863259520:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045326.535254:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863259520:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 266us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045326.535261:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 75 00000100:00080000:3.0:1784045326.535277:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045326.535825:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045326.535872:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045326.535893:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863259648 00000100:00100000:2.0:1784045326.535899:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863259648 00000100:00100000:2.0:1784045326.535932:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 76 00000100:00100000:2.0:1784045326.535940:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863259648:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045326.535990:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863259648:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 50us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045326.536712:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 76 00000100:00080000:2.0:1784045326.536792:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045326.537435:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863259136 00000100:00100000:1.0:1784045326.537465:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863259136 00000100:00100000:1.0:1784045326.537512:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863259392 00000100:00100000:1.0:1784045326.537515:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863259392 00000100:00100000:1.0:1784045326.537537:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 152 00000100:00100000:1.0:1784045326.537545:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863259136:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045326.537676:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863259136:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 131us (3904us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045326.537684:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 152 00000100:00100000:1.0:1784045326.537706:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 153 00000100:00100000:1.0:1784045326.537712:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863259392:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045326.537738:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863259392:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045326.537757:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 153 00000100:00080000:2.0:1784045326.538335:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045326.996191:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045326.996214:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8357b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873822208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045326.996283:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045326.996356:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873822208 00000100:00100000:0.0:1784045326.996363:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873822208 00000100:00100000:0.0:1784045326.996404:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784045326.996413:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873822208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784045326.996464:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784045326.996639:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873822208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 226us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045326.996647:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784045326.996693:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8357b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873822208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045326.997208:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873822336:0@lo:400:kworker.0 00000100:00100000:3.0:1784045326.997243:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045326.997273:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873822848:0@lo:400:kworker.0 00000100:00100000:3.0:1784045326.997309:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045326.997326:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873823360:0@lo:400:kworker.0 00000100:00100000:3.0:1784045326.997344:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045326.997357:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784045326.997362:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873822464:0@lo:400:kworker.0 00000100:00100000:3.0:1784045326.997378:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045326.997391:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873822976:0@lo:400:kworker.0 00000100:00100000:3.0:1784045326.997407:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045326.997419:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873823488:0@lo:400:kworker.0 00000100:00100000:3.0:1784045326.997434:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045326.997473:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873822336 00000100:00100000:1.0:1784045326.998247:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873822848 00000100:00100000:1.0:1784045326.998253:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873822848 00000100:00100000:1.0:1784045326.998300:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873823360 00000100:00100000:1.0:1784045326.998304:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873823360 00000100:00100000:1.0:1784045326.998317:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873822464 00000100:00100000:1.0:1784045326.998319:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873822464 00000100:00100000:1.0:1784045326.998332:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873822976 00000100:00100000:1.0:1784045326.998334:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873822976 00000100:00100000:1.0:1784045326.998346:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873823488 00000100:00100000:1.0:1784045326.998348:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873823488 00000100:00100000:1.0:1784045326.998362:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784045326.998369:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873822848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045326.998382:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873822336 00000100:00100000:3.0:1784045326.998415:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1784045326.998422:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873822336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045326.998427:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873822848:12345-0@lo:400:kworker.0 Request processed in 59us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045326.998434:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784045326.998467:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873822336:12345-0@lo:400:kworker.0 Request processed in 45us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045326.998478:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784045326.998479:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1784045326.998483:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873823360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045326.998512:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784045326.998519:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8364b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873822464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045326.998522:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873823360:12345-0@lo:400:kworker.0 Request processed in 39us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045326.998527:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784045326.998541:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784045326.998547:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8364b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873822464:12345-0@lo:400:kworker.0 Request processed in 29us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045326.998547:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8364aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873822976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045326.998553:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784045326.998565:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784045326.998571:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873823488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045326.998572:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8364aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873822976:12345-0@lo:400:kworker.0 Request processed in 26us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045326.998577:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1784045326.998595:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784045326.998605:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045326.998618:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873822720:0@lo:400:kworker.0 00000100:00100000:0.0:1784045326.998733:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873822592:0@lo:400:kworker.0 00000100:00100000:1.0:1784045327.007635:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045327.008852:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873823232:0@lo:400:kworker.0 00000100:00100000:1.0:1784045327.008907:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045327.008929:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873823744:0@lo:400:kworker.0 00000100:00100000:1.0:1784045327.008949:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045327.009002:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873823232 00000100:00100000:1.0:1784045327.009009:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873823232 00000100:00100000:1.0:1784045327.009059:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873823744 00000100:00100000:1.0:1784045327.009062:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873823744 00000100:00100000:1.0:1784045327.009089:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784045327.009098:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873823232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045327.009149:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873823232:12345-0@lo:400:kworker.0 Request processed in 53us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045327.009156:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784045327.009179:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784045327.009185:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873823744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045327.009211:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873823744:12345-0@lo:400:kworker.0 Request processed in 27us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045327.009217:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1784045327.009232:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045327.009236:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784045327.009259:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915b9500 x1870706873823232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045327.009273:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873823232:0@lo:400:kworker.0 00010000:00080000:1.0:1784045327.009302:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915b9180 x1870706873823744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045327.009309:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873823744:0@lo:400:kworker.0 00000100:00100000:3.0:1784045327.015052:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873823488:12345-0@lo:400:kworker.0 Request processed in 16467us (17602us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045327.015072:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784045327.015255:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873822464:0@lo:400:kworker.0 00010000:00080000:3.0:1784045327.015274:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf437100 x1870706873822976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045327.015285:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873822976:0@lo:400:kworker.0 00010000:00080000:3.0:1784045327.015296:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915b8e00 x1870706873823488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045327.015303:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873823488:0@lo:400:kworker.0 00000100:00100000:3.0:1784045327.015315:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873823360:0@lo:400:kworker.0 00000100:00100000:3.0:1784045327.015325:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873822848:0@lo:400:kworker.0 00000100:00100000:3.0:1784045327.015335:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873822336:0@lo:400:kworker.0 00000100:00100000:0.0:1784045327.021741:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045327.021798:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873823104:0@lo:400:kworker.0 00000100:00100000:0.0:1784045327.021851:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045327.021872:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873823616:0@lo:400:kworker.0 00000100:00100000:0.0:1784045327.021894:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045327.021943:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873822592 00000100:00100000:0.0:1784045327.021950:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873822592 00000100:00100000:0.0:1784045327.021997:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784045327.022005:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873822592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045327.022061:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873822592:12345-0@lo:400:kworker.0 Request processed in 57us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045327.022069:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784045327.022093:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873823104 00000100:00100000:0.0:1784045327.022096:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873823104 00000100:00100000:0.0:1784045327.022127:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873823616 00000100:00100000:0.0:1784045327.022130:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873823616 00000100:00100000:0.0:1784045327.022167:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784045327.022173:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873823104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045327.022203:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873823104:12345-0@lo:400:kworker.0 Request processed in 30us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045327.022209:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784045327.022222:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784045327.022228:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873823616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045327.022251:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873823616:12345-0@lo:400:kworker.0 Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045327.022256:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1784045327.022291:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045327.022295:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045327.022331:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873822592:0@lo:400:kworker.0 00010000:00080000:0.0:1784045327.022344:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915ba680 x1870706873823104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045327.022353:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873823104:0@lo:400:kworker.0 00010000:00080000:0.0:1784045327.022361:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915bbb80 x1870706873823616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045327.022368:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873823616:0@lo:400:kworker.0 00000100:00100000:2.0:1784045327.026239:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873822720 00000100:00100000:2.0:1784045327.026254:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873822720 00000100:00100000:2.0:1784045327.026323:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784045327.026333:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873822720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045327.026457:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873822720:12345-0@lo:400:kworker.0 Request processed in 113us (18817us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045327.026465:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784045327.026495:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873822720:0@lo:400:kworker.0 00010000:00010000:3.0:1784045327.316218:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045327.510146:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873824000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045327.510254:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045327.510335:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045327.510342:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc10fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873823872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045327.510371:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045327.510413:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873824000 00000100:00100000:0.0:1784045327.510422:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873824000 00000100:00100000:0.0:1784045327.510496:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873823872 00000100:00100000:0.0:1784045327.510500:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873823872 00000100:00100000:0.0:1784045327.510517:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784045327.510526:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873824000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784045327.510562:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045327.510611:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873824000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045327.510619:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784045327.510637:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784045327.510643:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873823872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045327.510669:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045327.510692:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873823872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045327.510698:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1784045327.510740:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc10fa680 x1870706873823872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045327.510762:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc10fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873823872:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1784045327.510773:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83578380 x1870706873824000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045327.510784:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873824000:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784045328.340708:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045329.364143:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045330.068165:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045330.068197:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873824128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784045330.068288:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045330.083141:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873824256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045330.083236:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045330.083314:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873824128 00000100:00100000:0.0:1784045330.083324:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873824128 00000100:00100000:0.0:1784045330.083386:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873824256 00000100:00100000:0.0:1784045330.083390:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873824256 00000100:00100000:0.0:1784045330.083412:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784045330.083422:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873824128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784045330.083481:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045330.083536:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873824128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (15248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045330.083544:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784045330.083562:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784045330.083568:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873824256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784045330.083592:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045330.084721:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873824256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1147us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045330.084731:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1784045330.084757:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784045330.084801:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83578380 x1870706873824256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045330.084836:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83578380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873824256:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1784045330.085057:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83648700 x1870706873824128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045330.085072:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873824128:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784045330.407926:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045330.600324:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873824384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045330.600397:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045330.601984:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873824384 00000100:00100000:3.0:1784045330.601996:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873824384 00000100:00100000:3.0:1784045330.602050:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784045330.602060:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873824384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045330.602092:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045330.602170:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873824384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045330.602178:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784045330.605906:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873824384:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784045331.412492:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045331.650417:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045331.650477:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045331.650510:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045331.650537:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045331.650556:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045331.650578:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045331.650631:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863260032 00000100:00100000:1.0:1784045331.650639:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863260032 00000100:00100000:1.0:1784045331.650688:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863260288 00000100:00100000:1.0:1784045331.650691:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863260288 00000100:00100000:1.0:1784045331.650704:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863259904 00000100:00100000:1.0:1784045331.650706:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863259904 00000100:00100000:1.0:1784045331.650717:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863260160 00000100:00100000:1.0:1784045331.650719:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863260160 00000100:00100000:1.0:1784045331.650735:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 160 00000100:00100000:1.0:1784045331.650744:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863260032:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045331.650826:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863260032:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 70us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045331.650834:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 160 00000100:00100000:1.0:1784045331.650864:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 161 00000100:00100000:1.0:1784045331.650870:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863260288:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045331.650900:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863260288:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 31us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045331.650914:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 161 00000100:00100000:1.0:1784045331.650931:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 162 00000100:00100000:1.0:1784045331.650937:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863259904:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045331.650962:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863259904:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045331.650968:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 162 00000100:00100000:1.0:1784045331.650982:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 163 00000100:00100000:1.0:1784045331.650988:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863260160:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045331.651012:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863260160:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045331.651018:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 163 00000100:00100000:1.0:1784045331.651038:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863260544 00000100:00100000:1.0:1784045331.651043:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863260544 00000100:00100000:1.0:1784045331.651076:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 81 00000100:00100000:1.0:1784045331.651082:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863260544:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045331.651112:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863260544:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 28us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045331.651120:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 81 00000100:00080000:1.0:1784045331.651144:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045331.651149:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045331.651152:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784045331.652969:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045331.653050:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863259776 00000100:00100000:0.0:1784045331.653060:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863259776 00000100:00100000:0.0:1784045331.653115:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 308 00000100:00100000:0.0:1784045331.653124:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863259776:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045331.653185:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863259776:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 61us (2776us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045331.653192:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 308 00000100:00100000:0.0:1784045331.653228:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863260416 00000100:00100000:0.0:1784045331.653232:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863260416 00000100:00100000:0.0:1784045331.653265:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 82 00000100:00100000:0.0:1784045331.653283:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8364b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863260416:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045331.653325:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8364b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863260416:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 54us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045331.653333:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 82 00000100:00080000:0.0:1784045331.653351:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045332.122051:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873824640:0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.122177:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045332.122253:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873825152:0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.122286:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045332.122311:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873825664:0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.122335:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045332.122354:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873826176:0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.122380:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045332.122412:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784045332.122419:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873824768:0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.122485:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045332.122507:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873825280:0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.122529:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045332.122545:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873825792:0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.122565:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045332.122606:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873825664 00000100:00100000:0.0:1784045332.122616:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873825664 00000100:00100000:3.0:1784045332.125264:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873824640 00000100:00100000:3.0:1784045332.125283:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873824640 00000100:00100000:3.0:1784045332.125367:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1784045332.125379:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873824640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045332.125537:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873824640:12345-0@lo:400:kworker.0 Request processed in 161us (3360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045332.125546:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1784045332.125591:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873824768 00000100:00100000:3.0:1784045332.125596:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873824768 00000100:00100000:3.0:1784045332.125626:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873825280 00000100:00100000:3.0:1784045332.125630:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873825280 00000100:00100000:3.0:1784045332.125652:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873825792 00000100:00100000:3.0:1784045332.125655:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873825792 00000100:00100000:3.0:1784045332.127018:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784045332.127029:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873824768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.127264:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873826176 00000100:00100000:0.0:1784045332.127273:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873826176 00000100:00100000:0.0:1784045332.127302:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784045332.127310:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873825664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.127693:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873825664:12345-0@lo:400:kworker.0 Request processed in 383us (5355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045332.127702:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784045332.127722:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784045332.127729:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873826176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.127774:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873826176:12345-0@lo:400:kworker.0 Request processed in 46us (5393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045332.127780:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784045332.127828:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784045332.127845:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873825280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.127881:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873825280:12345-0@lo:400:kworker.0 Request processed in 45us (5350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045332.127887:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784045332.127904:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784045332.127910:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873825792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.127939:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873825792:12345-0@lo:400:kworker.0 Request processed in 29us (5373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045332.127945:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1784045332.127963:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045332.127969:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045332.127972:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045332.128407:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8364bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873824896:0@lo:400:kworker.0 00000100:00100000:1.0:1784045332.128470:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045332.128498:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873825408:0@lo:400:kworker.0 00000100:00100000:1.0:1784045332.128529:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045332.128540:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873825920:0@lo:400:kworker.0 00000100:00100000:1.0:1784045332.128554:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045332.128566:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1784045332.128571:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873824512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045332.128582:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045332.128590:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873825024:0@lo:400:kworker.0 00000100:00100000:1.0:1784045332.128601:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045332.128607:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873825536:0@lo:400:kworker.0 00000100:00100000:1.0:1784045332.128624:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045332.128636:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873826048:0@lo:400:kworker.0 00000100:00100000:1.0:1784045332.128648:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045332.128684:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873825536 00000100:00100000:1.0:1784045332.128691:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873825536 00000100:00100000:1.0:1784045332.128730:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873826048 00000100:00100000:1.0:1784045332.128734:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873826048 00000100:00100000:1.0:1784045332.128753:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784045332.128761:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873825536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045332.128800:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873825536:12345-0@lo:400:kworker.0 Request processed in 41us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045332.128806:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784045332.128835:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784045332.128849:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873826048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045332.128878:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873826048:12345-0@lo:400:kworker.0 Request processed in 38us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045332.128884:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1784045332.128934:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf434380 x1870706873825536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045332.128950:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873825536:0@lo:400:kworker.0 00010000:00080000:1.0:1784045332.128960:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915c1c00 x1870706873826048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045332.128968:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873826048:0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.129310:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873825152 00000100:00100000:0.0:1784045332.129315:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873825152 00000100:00100000:0.0:1784045332.129340:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873824896 00000100:00100000:0.0:1784045332.129343:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873824896 00000100:00100000:0.0:1784045332.129352:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873824512 00000100:00100000:0.0:1784045332.129354:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873824512 00000100:00100000:0.0:1784045332.129375:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784045332.129381:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873825152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.129424:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873825152:12345-0@lo:400:kworker.0 Request processed in 43us (7138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045332.129430:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784045332.129465:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784045332.129472:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3623:x1870706873824896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.129506:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3623:x1870706873824896:12345-0@lo:400:kworker.0 Request processed in 35us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045332.129511:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784045332.129524:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784045332.129529:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873824512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784045332.129562:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784045332.129594:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873824512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045332.129600:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784045332.129633:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873824512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045332.129642:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8364bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873824896:0@lo:400:kworker.0 00000100:00080000:0.0:1784045332.129911:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045332.129916:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045332.129927:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873825408 00000100:00100000:0.0:1784045332.129932:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873825408 00000100:00100000:0.0:1784045332.129959:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873825920 00000100:00100000:0.0:1784045332.129961:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873825920 00000100:00100000:0.0:1784045332.129973:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873825024 00000100:00100000:0.0:1784045332.129976:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873825024 00000100:00100000:0.0:1784045332.129997:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784045332.130003:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873825408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.130045:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873825408:12345-0@lo:400:kworker.0 Request processed in 42us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045332.130051:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784045332.130062:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784045332.130520:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873825920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.130560:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873825920:12345-0@lo:400:kworker.0 Request processed in 492us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045332.130567:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784045332.130581:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784045332.130587:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873825024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045332.130613:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873825024:12345-0@lo:400:kworker.0 Request processed in 27us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045332.130620:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1784045332.130635:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045332.131767:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873825024:0@lo:400:kworker.0 00010000:00080000:0.0:1784045332.131842:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf435880 x1870706873825408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045332.131864:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873825408:0@lo:400:kworker.0 00010000:00080000:0.0:1784045332.131879:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf434e00 x1870706873825920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045332.131888:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873825920:0@lo:400:kworker.0 00000100:00100000:3.0:1784045332.133103:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873824768:12345-0@lo:400:kworker.0 Request processed in 6071us (10612us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045332.133119:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784045332.133243:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873824768:0@lo:400:kworker.0 00000100:00100000:3.0:1784045332.133263:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873825280:0@lo:400:kworker.0 00000100:00100000:3.0:1784045332.133277:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873825792:0@lo:400:kworker.0 00000100:00100000:3.0:1784045332.133295:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873824640:0@lo:400:kworker.0 00000100:00100000:3.0:1784045332.133313:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873825152:0@lo:400:kworker.0 00010000:00080000:3.0:1784045332.133331:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf436680 x1870706873825664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045332.133341:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873825664:0@lo:400:kworker.0 00010000:00080000:3.0:1784045332.133352:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915c0a80 x1870706873826176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045332.133361:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873826176:0@lo:400:kworker.0 00010000:00010000:0.0:1784045332.435613:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045332.632345:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873826304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045332.632483:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045332.632703:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873826304 00000100:00100000:1.0:1784045332.632714:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873826304 00000100:00100000:1.0:1784045332.632787:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784045332.632799:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873826304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045332.632849:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045332.632903:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873826304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045332.632910:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:2.0:1784045332.633388:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833ec380 x1870706873826304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045332.633440:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873826304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045332.634404:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045332.634422:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873826432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045332.634529:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045332.634693:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873826432 00000100:00100000:3.0:1784045332.634701:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873826432 00000100:00100000:3.0:1784045332.634753:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784045332.634762:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873826432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784045332.634785:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045332.634840:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873826432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045332.634857:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1784045332.635053:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915c0a80 x1870706873826432/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045332.635130:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873826432:0@lo:13:osp-pre-1-1.0 00000020:00000004:3.0:1784045332.686282:0:12482:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784045332.687413:0:12482:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784045333.467013:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045334.484592:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784045334.919094:0:12579:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784045334.920600:0:12579:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784045335.192063:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873826560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045335.192135:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045335.192263:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873826560 00000100:00100000:1.0:1784045335.192272:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873826560 00000100:00100000:1.0:1784045335.192330:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784045335.192339:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873826560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045335.192366:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045335.192504:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873826688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784045335.192533:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784045335.192627:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045335.194276:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873826560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1932us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045335.194288:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784045335.194315:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873826688 00000100:00100000:1.0:1784045335.194332:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873826688 00000100:00100000:1.0:1784045335.194386:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784045335.194394:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873826688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045335.194413:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045335.194496:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873826688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045335.194502:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1784045335.194653:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915c2300 x1870706873826688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045335.194821:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873826688:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784045335.195245:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784045335.195331:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d4380 x1870706873826560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045335.195346:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873826560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784045335.511975:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045335.701737:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873826816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784045335.701864:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045335.701899:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873826816 00000100:00100000:0.0:1784045335.701907:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873826816 00000100:00100000:0.0:1784045335.702057:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784045335.702067:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873826816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045335.702175:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045335.702235:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873826816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 169us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045335.702294:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873826816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045335.707604:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00010000:3.0:1784045336.531828:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045336.775241:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045336.775288:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045336.775319:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045336.775341:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045336.775359:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045336.775404:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045336.775524:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863260800 00000100:00100000:1.0:1784045336.775533:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863260800 00000100:00100000:1.0:1784045336.775599:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863261056 00000100:00100000:1.0:1784045336.775603:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863261056 00000100:00100000:1.0:1784045336.775616:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863260928 00000100:00100000:1.0:1784045336.775618:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863260928 00000100:00100000:1.0:1784045336.775629:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863261184 00000100:00100000:1.0:1784045336.775631:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863261184 00000100:00100000:1.0:1784045336.775647:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 170 00000100:00100000:1.0:1784045336.775656:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863260800:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045336.775726:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863260800:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 72us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045336.775734:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 170 00000100:00100000:1.0:1784045336.775756:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 171 00000100:00100000:1.0:1784045336.775762:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2396:x1870706863261056:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045336.775799:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2396:x1870706863261056:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 37us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045336.775817:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 171 00000100:00100000:1.0:1784045336.775831:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 172 00000100:00100000:1.0:1784045336.775836:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863260928:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045336.775860:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863260928:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045336.775865:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 172 00000100:00100000:1.0:1784045336.775876:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 173 00000100:00100000:1.0:1784045336.775882:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2396:x1870706863261184:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045336.775904:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2396:x1870706863261184:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 23us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045336.775910:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 173 00000100:00100000:0.0:1784045336.776006:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045336.776031:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863260672 00000100:00100000:0.0:1784045336.776035:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863260672 00000100:00100000:0.0:1784045336.776065:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 310 00000100:00100000:0.0:1784045336.776071:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2396:x1870706863260672:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045336.776095:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2396:x1870706863260672:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 25us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045336.776101:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 310 00000100:00100000:0.0:1784045336.776136:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863261312 00000100:00100000:0.0:1784045336.776139:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863261312 00000100:00100000:0.0:1784045336.776164:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863261440 00000100:00100000:0.0:1784045336.776172:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863261440 00000100:00100000:0.0:1784045336.776196:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:0.0:1784045336.776202:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2393:x1870706863261312:12345-192.168.203.44@tcp:9:kworker.0 00000020:00000080:0.0:1784045336.776220:0:8648:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c6d7 00000100:00080000:0.0:1784045336.776229:0:8648:0:(import.c:65:import_set_state_nolock()) ffff939cb6874000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784045336.776273:0:8648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1784045336.776388:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+2:2393:x1870706863261312:12345-192.168.203.44@tcp:9:kworker.0 Request processed in 185us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045336.776396:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:0.0:1784045336.776407:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:0.0:1784045336.776413:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2393:x1870706863261440:12345-192.168.203.44@tcp:9:kworker.0 00000100:00080000:1.0:1784045336.779628:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045336.779638:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045336.779641:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784045336.779644:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1784045336.779864:0:8648:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c6de 00000100:00080000:0.0:1784045336.779879:0:8648:0:(import.c:65:import_set_state_nolock()) ffff939cb7b8f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784045336.779977:0:8648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1784045336.780160:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+2:2393:x1870706863261440:12345-192.168.203.44@tcp:9:kworker.0 Request processed in 3742us (4148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045336.780169:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00010000:00010000:1.0:1784045336.794658:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045336.801730:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784045336.881740:0:12678:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045336.881984:0:12678:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784045337.235734:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873826944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045337.235835:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045337.235930:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873826944 00000100:00100000:2.0:1784045337.235939:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873826944 00000100:00100000:2.0:1784045337.235994:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784045337.236004:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873826944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784045337.236046:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784045337.236097:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873826944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045337.236105:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784045337.236168:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873826944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045337.238292:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873827200:0@lo:400:kworker.0 00000100:00100000:3.0:1784045337.238370:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045337.238419:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873827712:0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.239911:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873827072:0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.239998:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045337.240063:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873827584:0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.240090:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045337.240113:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873828096:0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.240132:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045337.240159:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784045337.240166:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873827456:0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.240188:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045337.240206:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873827968:0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.240227:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045337.240244:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873828480:0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.240265:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045337.240304:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873827200 00000100:00100000:2.0:1784045337.240315:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873827200 00000100:00100000:2.0:1784045337.240376:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873827584 00000100:00100000:2.0:1784045337.240379:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873827584 00000100:00100000:2.0:1784045337.240405:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873828096 00000100:00100000:2.0:1784045337.240408:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873828096 00000100:00100000:2.0:1784045337.240427:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784045337.240435:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873827200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.240531:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873827200:12345-0@lo:400:kworker.0 Request processed in 95us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045337.240539:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784045337.240558:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784045337.240582:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873827584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.240622:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873827584:12345-0@lo:400:kworker.0 Request processed in 42us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045337.240629:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784045337.240642:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784045337.240649:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873828096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.240814:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873828096:12345-0@lo:400:kworker.0 Request processed in 166us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045337.240821:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784045337.240845:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873827456 00000100:00100000:2.0:1784045337.240848:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873827456 00000100:00100000:2.0:1784045337.240875:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784045337.240882:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873827456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.240915:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873827456:12345-0@lo:400:kworker.0 Request processed in 34us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045337.240921:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784045337.240939:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873827968 00000100:00100000:2.0:1784045337.240942:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873827968 00000100:00100000:2.0:1784045337.240971:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873828480 00000100:00100000:2.0:1784045337.240975:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873828480 00000100:00100000:2.0:1784045337.240996:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784045337.241003:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873827968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045337.241843:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873827328:0@lo:400:kworker.0 00000100:00100000:1.0:1784045337.241895:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045337.241928:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873827840:0@lo:400:kworker.0 00000100:00100000:1.0:1784045337.241953:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045337.241973:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873828352:0@lo:400:kworker.0 00000100:00100000:1.0:1784045337.241994:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045337.242026:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873827840 00000100:00100000:1.0:1784045337.242031:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873827840 00000100:00100000:3.0:1784045337.242498:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045337.242799:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873827968:12345-0@lo:400:kworker.0 Request processed in 32us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045337.242812:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784045337.242830:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873828224:0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.242841:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873828352 00000100:00100000:2.0:1784045337.242848:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873828352 00000100:00100000:3.0:1784045337.242895:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045337.242906:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784045337.242919:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873828480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045337.242961:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873827200:0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.243000:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873828480:12345-0@lo:400:kworker.0 Request processed in 83us (2731us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045337.243010:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784045337.243019:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873827328 00000100:00100000:3.0:1784045337.243027:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873827328 00000100:00100000:2.0:1784045337.243031:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784045337.243064:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873827712 00000100:00100000:3.0:1784045337.243069:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873827712 00000100:00100000:3.0:1784045337.243084:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873828224 00000100:00100000:3.0:1784045337.243087:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873828224 00000100:00100000:3.0:1784045337.243102:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1784045337.243121:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873827328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.243123:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873828352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.243192:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873828352:12345-0@lo:400:kworker.0 Request processed in 83us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045337.243213:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784045337.243215:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873827328:12345-0@lo:400:kworker.0 Request processed in 92us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045337.243239:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784045337.243249:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784045337.243261:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873827712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045337.243268:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784045337.243282:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873828224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.243326:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873827712:12345-0@lo:400:kworker.0 Request processed in 65us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045337.243336:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784045337.243343:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873828224:12345-0@lo:400:kworker.0 Request processed in 64us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045337.243356:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:2.0:1784045337.243368:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045337.243377:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045337.243379:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045337.243386:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045337.243392:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873827072 00000100:00100000:3.0:1784045337.243398:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873827072 00000100:00100000:3.0:1784045337.243472:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1784045337.243482:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873827072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.243489:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873827456:0@lo:400:kworker.0 00000100:00100000:1.0:1784045337.243593:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784045337.243600:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873827840:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1784045337.243641:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915c0380 x1870706873827968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045337.243654:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873827968:0@lo:400:kworker.0 00000100:00100000:3.0:1784045337.244114:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873827072:12345-0@lo:400:kworker.0 Request processed in 631us (4113us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045337.244134:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00080000:3.0:1784045337.244198:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915c0e00 x1870706873827712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045337.244210:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873827712:0@lo:400:kworker.0 00010000:00080000:3.0:1784045337.244222:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915c0a80 x1870706873828224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045337.244230:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873828224:0@lo:400:kworker.0 00000100:00080000:3.0:1784045337.247907:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045337.249269:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873827840:12345-0@lo:400:kworker.0 Request processed in 5655us (7300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045337.249288:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784045337.249389:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873827328:0@lo:400:kworker.0 00010000:00080000:1.0:1784045337.249408:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915c1880 x1870706873827840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045337.249419:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873827840:0@lo:400:kworker.0 00010000:00080000:1.0:1784045337.249431:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915c1c00 x1870706873828352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045337.249439:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873828352:0@lo:400:kworker.0 00010000:00080000:2.0:1784045337.258208:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b836d0700 x1870706873828480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045337.258259:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873828480:0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.258278:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873827072:0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.258292:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873827584:0@lo:400:kworker.0 00000100:00100000:2.0:1784045337.258304:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873828096:0@lo:400:kworker.0 00010000:00010000:3.0:1784045337.556950:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045337.748237:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045337.748261:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873828736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045337.748262:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873828608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045337.751275:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045337.751414:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045337.751754:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873828608 00000100:00100000:2.0:1784045337.751764:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873828608 00000100:00100000:2.0:1784045337.751825:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873828736 00000100:00100000:2.0:1784045337.751828:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873828736 00000100:00100000:2.0:1784045337.751852:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784045337.751861:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873828608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784045337.751893:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045337.752217:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784045337.752228:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873828736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784045337.752241:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045337.758948:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873828608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7079us (7670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045337.758964:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1784045337.759001:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b81998380 x1870706873828608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045337.759027:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873828608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045337.759245:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873828736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7018us (7829us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045337.759253:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1784045337.759756:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833edf80 x1870706873828736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045337.759795:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873828736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784045338.580133:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784045339.577158:0:12775:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784045339.577672:0:12775:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784045339.604673:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045340.308628:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045340.308653:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873828864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784045340.308718:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045340.308809:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873828864 00000100:00100000:3.0:1784045340.308817:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873828864 00000100:00100000:3.0:1784045340.308871:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784045340.308881:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873828864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784045340.308908:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045340.308952:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873828864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045340.308959:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1784045340.308978:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784045340.309006:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b81999880 x1870706873828864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045340.309022:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873828864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045340.321010:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045340.321045:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873828992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045340.321112:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045340.321246:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873828992 00000100:00100000:3.0:1784045340.321254:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873828992 00000100:00100000:3.0:1784045340.321318:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784045340.321326:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873828992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045340.321347:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045340.321400:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873828992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045340.321407:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1784045340.321926:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784045340.321961:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b81999880 x1870706873828992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045340.321981:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873828992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784045340.631554:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045340.821141:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045340.821162:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873829120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045340.821232:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045340.821366:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873829120 00000100:00100000:3.0:1784045340.821373:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873829120 00000100:00100000:3.0:1784045340.821422:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784045340.821431:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873829120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045340.821481:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045340.821539:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873829120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045340.821547:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784045340.821684:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873829120:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784045341.652737:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045341.913794:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045341.913834:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045341.913904:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045341.913933:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045341.914322:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045341.914375:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863261696 00000100:00100000:1.0:1784045341.914384:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863261696 00000100:00100000:1.0:1784045341.914442:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863261952 00000100:00100000:1.0:1784045341.914509:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863261952 00000100:00100000:1.0:1784045341.914527:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863261824 00000100:00100000:1.0:1784045341.914531:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863261824 00000100:00100000:1.0:1784045341.914547:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 180 00000100:00100000:1.0:1784045341.914556:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863261696:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045341.914624:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863261696:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 69us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045341.914648:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 180 00000100:00100000:1.0:1784045341.914673:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 181 00000100:00100000:1.0:1784045341.914679:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863261952:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045341.914705:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863261952:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045341.914712:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 181 00000100:00100000:1.0:1784045341.914724:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 182 00000100:00100000:1.0:1784045341.914730:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8364ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863261824:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045341.914768:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8364ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863261824:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 38us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045341.914775:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 182 00000100:00100000:1.0:1784045341.914796:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863261568 00000100:00100000:1.0:1784045341.914800:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863261568 00000100:00100000:1.0:1784045341.914827:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 312 00000100:00100000:1.0:1784045341.914833:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863261568:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045341.914856:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863261568:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 23us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045341.914861:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 312 00000100:00080000:1.0:1784045341.914886:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784045341.914890:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045341.915291:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863262080 00000100:00100000:1.0:1784045341.915296:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863262080 00000100:00100000:1.0:1784045341.915335:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 183 00000100:00100000:1.0:1784045341.915342:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8364bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863262080:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045341.915388:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8364bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863262080:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 46us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045341.915395:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 183 00000100:00080000:0.0:1784045341.915475:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:3.0:1784045342.119225:0:12872:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784045342.119612:0:12872:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784045342.355862:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873829376:0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.355931:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045342.355981:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873829888:0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.356003:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045342.356042:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873830400:0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.356064:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045342.356088:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1784045342.356095:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873829248:0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.356125:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045342.356145:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873829760:0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.356169:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045342.356187:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873830272:0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.356209:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045342.356226:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873830784:0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.356248:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045342.356273:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873829632:0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.356431:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873829504:0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.356492:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045342.356510:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873830016:0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.356527:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045342.356540:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873830528:0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.356555:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045342.356580:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873829248 00000100:00100000:3.0:1784045342.356587:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873829248 00000100:00100000:3.0:1784045342.356631:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1784045342.356641:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873829248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.356689:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873829248:12345-0@lo:400:kworker.0 Request processed in 50us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045342.356697:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1784045342.356737:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873829760 00000100:00100000:3.0:1784045342.356741:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873829760 00000100:00100000:3.0:1784045342.356775:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873829504 00000100:00100000:3.0:1784045342.356778:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873829504 00000100:00100000:3.0:1784045342.356791:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784045342.356797:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873829760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.356833:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873829760:12345-0@lo:400:kworker.0 Request processed in 35us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045342.356839:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784045342.356851:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784045342.356857:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873829504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.356889:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873829504:12345-0@lo:400:kworker.0 Request processed in 32us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045342.356895:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784045342.356912:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873829376 00000100:00100000:3.0:1784045342.356915:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873829376 00000100:00100000:3.0:1784045342.356933:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873829888 00000100:00100000:3.0:1784045342.356936:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873829888 00000100:00100000:3.0:1784045342.356956:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873830400 00000100:00100000:3.0:1784045342.356959:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873830400 00000100:00100000:3.0:1784045342.356971:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873830016 00000100:00100000:3.0:1784045342.356974:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873830016 00000100:00100000:3.0:1784045342.356985:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873830528 00000100:00100000:3.0:1784045342.356987:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873830528 00000100:00100000:3.0:1784045342.356999:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1784045342.357004:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873829376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.357034:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873829376:12345-0@lo:400:kworker.0 Request processed in 29us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045342.357040:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1784045342.357060:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1784045342.357066:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873829888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.357095:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873829888:12345-0@lo:400:kworker.0 Request processed in 30us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045342.357102:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1784045342.357113:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1784045342.357118:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873830400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.357143:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873830400:12345-0@lo:400:kworker.0 Request processed in 25us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045342.357148:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1784045342.357158:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1784045342.357164:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873830016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.357190:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873830016:12345-0@lo:400:kworker.0 Request processed in 26us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045342.357196:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1784045342.357206:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1784045342.357212:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873830528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.357235:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873830528:12345-0@lo:400:kworker.0 Request processed in 25us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045342.357241:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:3.0:1784045342.357261:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784045342.357265:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045342.357304:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873829504:0@lo:400:kworker.0 00010000:00080000:3.0:1784045342.357318:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b5180 x1870706873830016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045342.357339:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873830016:0@lo:400:kworker.0 00010000:00080000:3.0:1784045342.357350:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820d880 x1870706873830528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045342.357359:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873830528:0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.357387:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873829248:0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.357396:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873829760:0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.357404:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873829376:0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.357412:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873829888:0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.357420:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873830400:0@lo:400:kworker.0 00000100:00100000:3.0:1784045342.357624:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045342.357635:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873830912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045342.357667:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045342.357803:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873830912 00000100:00100000:0.0:1784045342.357808:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873830912 00000100:00100000:0.0:1784045342.357837:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784045342.357844:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873830912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784045342.357869:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784045342.357903:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873830912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045342.357909:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784045342.357970:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873830912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045342.358055:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045342.358083:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873830144:0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.358104:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045342.358130:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873830656:0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.358152:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045342.358179:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873829632 00000100:00100000:2.0:1784045342.358183:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873829632 00000100:00100000:2.0:1784045342.358203:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1784045342.358209:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873829632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045342.358245:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873829632:12345-0@lo:400:kworker.0 Request processed in 35us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045342.358251:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1784045342.358399:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873830272 00000100:00100000:0.0:1784045342.358403:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873830272 00000100:00100000:0.0:1784045342.358439:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873830784 00000100:00100000:0.0:1784045342.358463:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873830784 00000100:00100000:0.0:1784045342.358476:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873830144 00000100:00100000:0.0:1784045342.358479:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873830144 00000100:00100000:0.0:1784045342.358488:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873830656 00000100:00100000:0.0:1784045342.358491:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873830656 00000100:00100000:0.0:1784045342.358502:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784045342.358508:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873830272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.358542:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873830272:12345-0@lo:400:kworker.0 Request processed in 34us (2332us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045342.358548:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784045342.358559:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784045342.358564:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873830784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.358588:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873830784:12345-0@lo:400:kworker.0 Request processed in 24us (2339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045342.358594:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784045342.358605:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784045342.358610:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873830144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.358638:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873830144:12345-0@lo:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045342.358644:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784045342.358654:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784045342.358660:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873830656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045342.358684:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873830656:12345-0@lo:400:kworker.0 Request processed in 25us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045342.358690:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784045342.358925:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873829632:0@lo:400:kworker.0 00010000:00080000:2.0:1784045342.358947:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b4700 x1870706873830144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045342.358956:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873830144:0@lo:400:kworker.0 00010000:00080000:2.0:1784045342.358965:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820e300 x1870706873830656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045342.358973:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873830656:0@lo:400:kworker.0 00000100:00080000:3.0:1784045342.363091:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045342.363106:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784045342.363309:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b5880 x1870706873830272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045342.363328:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873830272:0@lo:400:kworker.0 00010000:00080000:3.0:1784045342.363345:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820e680 x1870706873830784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045342.363355:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873830784:0@lo:400:kworker.0 00010000:00010000:1.0:1784045342.682859:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045342.867595:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873831040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045342.867670:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045342.867757:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873831040 00000100:00100000:0.0:1784045342.867765:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873831040 00000100:00100000:0.0:1784045342.867809:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784045342.867819:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873831040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784045342.867847:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045342.867891:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873831040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045342.867898:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1784045342.867939:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83579180 x1870706873831040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045342.867957:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83579180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873831040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045342.868083:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045342.868093:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873831168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045342.868120:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045342.868150:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873831168 00000100:00100000:1.0:1784045342.868154:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873831168 00000100:00100000:1.0:1784045342.868179:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784045342.868186:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873831168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045342.868196:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045342.868227:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873831168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045342.868233:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1784045342.868266:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833efb80 x1870706873831168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045342.868279:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873831168:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1784045342.874794:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e3b4a878-6779-48a0-8f76-90916f645fbb 00000020:00000080:2.0:1784045342.874807:0:8407:0:(genops.c:906:class_export_put()) final put ffff939b82a19800/e3b4a878-6779-48a0-8f76-90916f645fbb 00000020:00000080:3.0:1784045342.874921:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82a19800/e3b4a878-6779-48a0-8f76-90916f645fbb for lustre-OST0000 00000020:00000080:3.0:1784045342.874974:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cb6874000 for lustre-OST0000 00000001:00100000:3.0:1784045342.879126:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e3b4a878-6779-48a0-8f76-90916f645fbb 00000020:00000080:3.0:1784045342.879138:0:9491:0:(genops.c:906:class_export_put()) final put ffff939cb7b8d000/e3b4a878-6779-48a0-8f76-90916f645fbb 00000020:00000080:0.0:1784045342.879225:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb7b8d000/e3b4a878-6779-48a0-8f76-90916f645fbb for lustre-OST0001 00000020:00000080:0.0:1784045342.879266:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cb7b8f000 for lustre-OST0001 00010000:00010000:3.0:1784045343.710869:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045344.729563:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045345.428325:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045345.428348:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873831296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045345.428414:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045345.428495:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873831296 00000100:00100000:2.0:1784045345.428502:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873831296 00000100:00100000:2.0:1784045345.428545:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784045345.428553:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873831296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045345.428580:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045345.428617:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873831296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045345.428624:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:2.0:1784045345.428655:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b81998380 x1870706873831296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045345.428671:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873831296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045345.429147:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045345.429160:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873831424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045345.429196:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045345.429333:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873831424 00000100:00100000:1.0:1784045345.429340:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873831424 00000100:00100000:1.0:1784045345.429378:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784045345.429385:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873831424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045345.429399:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045345.429438:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873831424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045345.429483:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:1.0:1784045345.429521:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833efb80 x1870706873831424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045345.429534:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873831424:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784045345.429858:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784045345.748213:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045345.940367:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045345.940396:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873831552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045345.940483:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045345.940555:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873831552 00000100:00100000:0.0:1784045345.940562:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873831552 00000100:00100000:0.0:1784045345.940611:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784045345.940620:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873831552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045345.940655:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045345.940701:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873831552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045345.940731:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784045345.941031:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873831552:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1784045346.310687:0:13017:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1784045346.772429:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045347.008403:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045347.008511:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045347.008517:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863262208 00000100:00100000:3.0:1784045347.008536:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863262208 00000100:00100000:3.0:1784045347.008637:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 314 00000100:00100000:3.0:1784045347.008659:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863262208:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045347.008768:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863262208:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 121us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045347.008778:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 314 00000100:00100000:2.0:1784045347.009035:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863262464 00000100:00100000:2.0:1784045347.009107:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863262464 00000100:00100000:2.0:1784045347.009245:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 190 00000100:00080000:3.0:1784045347.009247:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045347.009260:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863262464:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045347.009729:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863262464:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 473us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045347.009738:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 190 00000100:00100000:1.0:1784045347.012407:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045347.012500:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045347.012553:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045347.012678:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863262720 00000100:00100000:2.0:1784045347.012690:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863262720 00000100:00100000:2.0:1784045347.012779:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863262336 00000100:00100000:2.0:1784045347.012783:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863262336 00000100:00100000:2.0:1784045347.012797:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863262592 00000100:00100000:2.0:1784045347.012800:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863262592 00000100:00100000:2.0:1784045347.012817:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 191 00000100:00100000:2.0:1784045347.012829:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863262720:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045347.012917:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863262720:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 89us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045347.012924:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 191 00000100:00100000:2.0:1784045347.012942:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 192 00000100:00100000:2.0:1784045347.012958:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863262336:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045347.012993:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863262336:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 45us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045347.013000:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 192 00000100:00100000:2.0:1784045347.013012:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 193 00000100:00100000:2.0:1784045347.013018:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863262592:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045347.013042:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863262592:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045347.013066:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 193 00000100:00080000:1.0:1784045347.014071:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045347.014178:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784045347.477859:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873832064:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.477929:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478245:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873832576:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.478277:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478309:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873833088:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.478331:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478363:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1784045347.478370:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873831680:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.478414:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478435:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873832192:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.478486:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478502:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873832704:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.478522:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478537:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873833216:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.478553:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478578:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873831808:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.478599:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478614:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873832320:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.478632:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478646:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873832832:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.478668:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478682:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8357b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873833344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045347.478700:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478728:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784045347.478735:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873831936:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.478755:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478768:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873832448:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.478790:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478800:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873832960:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.478818:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045347.478842:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873831680 00000100:00100000:3.0:1784045347.478849:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873831680 00000100:00100000:3.0:1784045347.478898:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1784045347.478907:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873831680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.478955:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873831680:12345-0@lo:400:kworker.0 Request processed in 50us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045347.478963:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1784045347.479186:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873832576 00000100:00100000:0.0:1784045347.479191:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873832576 00000100:00100000:0.0:1784045347.479222:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873833088 00000100:00100000:0.0:1784045347.479225:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873833088 00000100:00100000:0.0:1784045347.479236:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873832704 00000100:00100000:0.0:1784045347.479238:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873832704 00000100:00100000:0.0:1784045347.479248:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873833216 00000100:00100000:0.0:1784045347.479250:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873833216 00000100:00100000:0.0:1784045347.479261:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784045347.479267:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873832576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.479303:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873832576:12345-0@lo:400:kworker.0 Request processed in 37us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.479310:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784045347.479324:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784045347.479329:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873833088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.479356:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873833088:12345-0@lo:400:kworker.0 Request processed in 27us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.479362:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784045347.479373:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784045347.479379:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873832704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.479404:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873832704:12345-0@lo:400:kworker.0 Request processed in 26us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.479410:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784045347.479420:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784045347.479426:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873833216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.479485:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873833216:12345-0@lo:400:kworker.0 Request processed in 60us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.479492:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784045347.479509:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873832064 00000100:00100000:0.0:1784045347.479513:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873832064 00000100:00100000:0.0:1784045347.479530:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873831808 00000100:00100000:0.0:1784045347.479532:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873831808 00000100:00100000:0.0:1784045347.479542:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873832320 00000100:00100000:0.0:1784045347.479544:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873832320 00000100:00100000:0.0:1784045347.479555:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873832832 00000100:00100000:0.0:1784045347.479557:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873832832 00000100:00100000:0.0:1784045347.479566:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873832448 00000100:00100000:0.0:1784045347.479569:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873832448 00000100:00100000:0.0:1784045347.479581:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873832960 00000100:00100000:0.0:1784045347.479583:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873832960 00000100:00100000:0.0:1784045347.479596:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1784045347.479601:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873832064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.479632:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873832064:12345-0@lo:400:kworker.0 Request processed in 31us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.479638:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1784045347.479651:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1784045347.479656:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873831808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.479690:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873831808:12345-0@lo:400:kworker.0 Request processed in 33us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.479696:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1784045347.479707:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1784045347.479723:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873832320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.479748:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873832320:12345-0@lo:400:kworker.0 Request processed in 36us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.479760:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1784045347.479771:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784045347.479777:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873832832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.479804:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873832832:12345-0@lo:400:kworker.0 Request processed in 27us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.479809:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784045347.479820:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784045347.479825:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873832448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.479851:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873832448:12345-0@lo:400:kworker.0 Request processed in 27us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.479857:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784045347.479868:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784045347.479873:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873832960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.479899:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873832960:12345-0@lo:400:kworker.0 Request processed in 26us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.479905:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784045347.479923:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873832192 00000100:00100000:0.0:1784045347.479927:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873832192 00000100:00100000:0.0:1784045347.479943:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873833344 00000100:00100000:0.0:1784045347.479946:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873833344 00000100:00100000:0.0:1784045347.479956:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873831936 00000100:00100000:0.0:1784045347.479958:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873831936 00000100:00100000:0.0:1784045347.479967:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784045347.479986:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873832192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.480021:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873832192:12345-0@lo:400:kworker.0 Request processed in 48us (1534us total) trans 0 rc 0/0 00000100:00080000:1.0:1784045347.480148:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784045347.480153:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045347.480155:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045347.480157:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045347.480260:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784045347.480274:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784045347.480279:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3625:x1870706873833344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784045347.480301:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784045347.480333:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3625:x1870706873833344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.480339:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784045347.480350:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784045347.480356:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873831936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.480382:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873831936:12345-0@lo:400:kworker.0 Request processed in 26us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045347.480387:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784045347.481245:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873831936:0@lo:400:kworker.0 00010000:00080000:0.0:1784045347.481274:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b836d0700 x1870706873832448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045347.481284:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873832448:0@lo:400:kworker.0 00010000:00080000:0.0:1784045347.481296:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820d180 x1870706873832960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045347.481304:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873832960:0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.481318:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873831808:0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.481330:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873832320:0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.481340:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873832832:0@lo:400:kworker.0 00000100:00100000:0.0:1784045347.481371:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8357b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873833344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045347.482927:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873831680:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.482955:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873832192:0@lo:400:kworker.0 00010000:00080000:3.0:1784045347.482978:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820e300 x1870706873832704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045347.482991:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873832704:0@lo:400:kworker.0 00010000:00080000:3.0:1784045347.483013:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b5880 x1870706873833216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045347.483024:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873833216:0@lo:400:kworker.0 00000100:00100000:3.0:1784045347.483044:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873832064:0@lo:400:kworker.0 00010000:00080000:3.0:1784045347.483063:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820e680 x1870706873832576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045347.483074:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873832576:0@lo:400:kworker.0 00010000:00080000:3.0:1784045347.483093:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c8820d880 x1870706873833088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045347.483104:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873833088:0@lo:400:kworker.0 00010000:00010000:3.0:1784045347.795779:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045347.987727:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045347.987752:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873833472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045347.987819:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045347.987977:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873833472 00000100:00100000:1.0:1784045347.987985:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873833472 00000100:00100000:1.0:1784045347.988040:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784045347.988050:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873833472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045347.988078:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045347.988131:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873833472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045347.988139:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784045347.988800:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045347.988815:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873833600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045347.988876:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045347.988908:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873833600 00000100:00100000:1.0:1784045347.988913:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873833600 00000100:00100000:1.0:1784045347.988939:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784045347.988945:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873833600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784045347.988960:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045347.988995:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873833600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045347.989001:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1784045347.989038:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833ed180 x1870706873833600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045347.989056:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873833600:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1784045347.989274:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833ee300 x1870706873833472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045347.989289:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873833472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784045348.821991:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045349.858248:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784045349.894316:0:13165:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca5468c60 20000000:00000080:0.0:1784045349.894343:0:13165:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939cc1390800 uarg=0000000000000000 20000000:01000000:0.0:1784045349.894406:0:13165:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784045349.894414:0:13165:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1784045349.894421:0:13165:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784045349.902184:0:13166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1784045349.902431:0:13165:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784045349.908613:0:13165:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784045349.908660:0:13165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.908688:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc106e600/0x5475624df454c675 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edce expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.908708:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b81986400/0x5475624df454c683 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c67c expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.908717:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b81986800/0x5475624df454c691 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c68a expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.908724:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b81987200/0x5475624df454c69f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c698 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.908756:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc2171800/0x5475624df454c6ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c6a6 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.908883:0:13165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c915aaa00/0x5475624df454c6c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee0d expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.908895:0:13165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.909682:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c915aaa00/0x5475624df454c6c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee0d expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.909718:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939c915aaa00/0x5475624df454c6c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee0d expref: 12 pid: 6490 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045349.909742:0:13165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1870706873833728:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045349.910117:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc2171800/0x5475624df454c6ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c6a6 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.910128:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc2171800/0x5475624df454c6ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c6a6 expref: 23 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045349.910139:0:13165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1870706873833856:0@lo:104: 00000100:00100000:1.0:1784045349.910193:0:13165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784045349.910287:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b81987200/0x5475624df454c69f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c698 expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.910296:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939b81987200/0x5475624df454c69f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c698 expref: 23 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045349.910323:0:13165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf436d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1870706873833984:0@lo:104: 00000100:00100000:1.0:1784045349.910347:0:13165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784045349.914000:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b81986800/0x5475624df454c691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c68a expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.914025:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939b81986800/0x5475624df454c691 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c68a expref: 23 pid: 6488 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045349.914043:0:13165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf436680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1870706873834112:0@lo:104: 00000100:00100000:1.0:1784045349.914115:0:13165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045349.917866:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873833856 00000100:00100000:0.0:1784045349.917891:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873833856 00000100:00100000:0.0:1784045349.917972:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873833984 00000100:00100000:0.0:1784045349.917976:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873833984 00000100:00100000:0.0:1784045349.918003:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784045349.918014:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:13165:x1870706873833856:12345-0@lo:104: 00010000:00010000:0.0:1784045349.918037:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c6ad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918169:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784045349.918175:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:13165:x1870706873833856:12345-0@lo:104: Request processed in 164us (7983us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045349.918183:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784045349.918204:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784045349.918211:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:13165:x1870706873833984:12345-0@lo:104: 00010000:00010000:0.0:1784045349.918219:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c69f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918281:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784045349.918287:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:13165:x1870706873833984:12345-0@lo:104: Request processed in 77us (7938us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045349.918293:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1784045349.918328:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784045349.918336:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c6ad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918343:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986a00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1784045349.918348:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c6ad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918357:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c6ad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045349.918365:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c6ad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045349.918371:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784045349.918422:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c6ad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918429:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045349.918480:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c6ad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918489:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454c6a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c6ad expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918512:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045349.918515:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c69f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918521:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1784045349.918524:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c69f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918532:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c69f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045349.918539:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c69f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045349.918544:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784045349.918559:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c69f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918565:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045349.918584:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c69f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918591:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454c698 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c69f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918601:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045349.918602:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045349.918604:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045349.918622:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873834240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045349.918677:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045349.918749:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873834368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045349.918776:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045349.918812:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873834240 00000100:00100000:0.0:1784045349.918818:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873834240 00010000:00010000:0.0:1784045349.918843:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc2171800/0x5475624df454c6ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c6a6 expref: 24 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045349.918864:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873834368 00000100:00100000:0.0:1784045349.918866:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873834368 00010000:00010000:0.0:1784045349.918877:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b81987200/0x5475624df454c69f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c698 expref: 25 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045349.918899:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784045349.918906:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+25:3624:x1870706873834240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045349.918917:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045349.918923:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc2171800/0x5475624df454c6ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c6a6 expref: 25 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918933:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc2171800/0x5475624df454c6ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c6a6 expref: 25 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.918955:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045349.918983:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+25:3624:x1870706873834240:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045349.918989:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784045349.919004:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784045349.919010:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873834368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045349.919018:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045349.919029:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b81987200/0x5475624df454c69f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c698 expref: 24 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.919038:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b81987200/0x5475624df454c69f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c698 expref: 24 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.919047:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045349.919076:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873834368:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045349.919082:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784045349.919130:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873834368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045349.919159:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873834240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045349.919361:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045349.923337:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b81986400/0x5475624df454c683 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c67c expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.923362:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939b81986400/0x5475624df454c683 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c67c expref: 23 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045349.923381:0:13165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf434e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1870706873834496:0@lo:104: 00000100:00100000:1.0:1784045349.923478:0:13165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784045349.928884:0:13165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc106e600/0x5475624df454c675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73edce expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.928911:0:13165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939cc106e600/0x5475624df454c675 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73edce expref: 12 pid: 6489 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045349.928943:0:13165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf434380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1870706873834624:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045349.931133:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873834112 00000100:00100000:3.0:1784045349.931153:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873834112 00000100:00100000:3.0:1784045349.931223:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873834496 00000100:00100000:3.0:1784045349.931227:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873834496 00000100:00100000:3.0:1784045349.931248:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784045349.931259:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:13165:x1870706873834112:12345-0@lo:104: 00010000:00010000:3.0:1784045349.931282:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c691 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045349.931342:0:13165:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11bec00 going to sleep for 11 seconds 00010000:00010000:3.0:1784045349.931387:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784045349.931394:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:13165:x1870706873834112:12345-0@lo:104: Request processed in 137us (17279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045349.931402:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784045349.931419:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784045349.931424:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:13165:x1870706873834496:12345-0@lo:104: 00010000:00010000:3.0:1784045349.931432:0:6480:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c683 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045349.931477:0:13165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1870706873833728:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045349.931493:0:6480:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784045349.931499:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:13165:x1870706873834496:12345-0@lo:104: Request processed in 75us (8022us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045349.931510:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1784045349.931527:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc2171800/0x5475624df454c6ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c6a6 expref: 23 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.931529:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045349.931538:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c691 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045349.931548:0:13165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1870706873833856:0@lo:104: 00010000:00010000:3.0:1784045349.931549:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986c00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045349.931555:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c691 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.931574:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c691 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045349.931583:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c691 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045349.931589:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784045349.931633:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c691 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.931640:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045349.931668:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c691 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.931675:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81986c00/0x5475624df454c68a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c691 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.931688:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045349.931691:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c683 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.931708:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986e00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045349.931711:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c683 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.931718:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c683 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045349.931725:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c683 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045349.931737:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784045349.931759:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c683 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045349.931761:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81987200/0x5475624df454c69f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c698 expref: 22 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.931774:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784045349.931785:0:13165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf436d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1870706873833984:0@lo:104: 00010000:00010000:3.0:1784045349.931797:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c683 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045349.931800:0:13165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf436680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1870706873834112:0@lo:104: 00010000:00010000:3.0:1784045349.931812:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81986e00/0x5475624df454c67c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c683 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045349.931816:0:13165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf434e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1870706873834496:0@lo:104: 00010000:00010000:3.0:1784045349.931838:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045349.931840:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045349.931842:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045349.931860:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873834752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045349.931910:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045349.931952:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873834880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045349.931979:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045349.932018:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873834752 00000100:00100000:3.0:1784045349.932022:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873834752 00010000:00010000:3.0:1784045349.932042:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b81986800/0x5475624df454c691 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c68a expref: 22 pid: 6488 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045349.932070:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873834880 00000100:00100000:3.0:1784045349.932073:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873834880 00010000:00010000:3.0:1784045349.932083:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b81986400/0x5475624df454c683 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c67c expref: 23 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045349.932099:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784045349.932111:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:3626:x1870706873834752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045349.932122:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045349.932128:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b81986800/0x5475624df454c691 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c68a expref: 23 pid: 6488 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.932153:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b81986800/0x5475624df454c691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c68a expref: 23 pid: 6488 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.932168:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81986800/0x5475624df454c691 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c68a expref: 23 pid: 6488 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.932184:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045349.932272:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:3626:x1870706873834752:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045349.932279:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784045349.932293:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784045349.932300:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:3623:x1870706873834880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045349.932308:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045349.932312:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b81986400/0x5475624df454c683 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c67c expref: 21 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.932320:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b81986400/0x5475624df454c683 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c67c expref: 21 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.932329:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81986400/0x5475624df454c683 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c67c expref: 21 pid: 6490 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.932337:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045349.932362:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:3623:x1870706873834880:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045349.932375:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784045349.932416:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873834880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045349.932465:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873834752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784045349.932481:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045349.934287:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045349.934819:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863262848 00000100:00100000:0.0:1784045349.934831:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863262848 00010000:00010000:0.0:1784045349.934882:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c915aaa00/0x5475624df454c6c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee0d expref: 13 pid: 6490 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045349.934924:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:0.0:1784045349.934934:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863262848:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045349.934952:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045349.934958:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c915aaa00/0x5475624df454c6c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee0d expref: 13 pid: 6490 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.934972:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c915aaa00/0x5475624df454c6c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee0d expref: 13 pid: 6490 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.934994:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915aaa00/0x5475624df454c6c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee0d expref: 13 pid: 6490 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.935038:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045349.935120:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:2395:x1870706863262848:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 185us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045349.935128:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:1.0:1784045349.939038:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045349.939200:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863262976 00000100:00100000:3.0:1784045349.939212:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863262976 00010000:00010000:3.0:1784045349.939265:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc106e600/0x5475624df454c675 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73edce expref: 12 pid: 6489 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045349.939316:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:3.0:1784045349.939328:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:2394:x1870706863262976:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045349.939347:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784045349.939418:0:13165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf434380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13165:1870706873834624:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045349.939503:0:13165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.939758:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc106e600/0x5475624df454c675 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73edce expref: 12 pid: 6489 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.939774:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc106e600/0x5475624df454c675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73edce expref: 12 pid: 6489 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.940053:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106e600/0x5475624df454c675 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73edce expref: 12 pid: 6489 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.940072:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.940081:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.940229:0:6482:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.940239:0:6482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.940245:0:6482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.940251:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.940258:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cda00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045349.940262:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.940271:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.940296:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045349.940308:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045349.940947:0:13165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045349.941234:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:2394:x1870706863262976:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 1903us (2206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045349.941246:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 45 00010000:00010000:0.0:1784045349.941737:0:13165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045349.941746:0:13165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b836cda00/0x5475624df454c6e5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045350.547806:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045350.547841:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873835136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045350.547845:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873835008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784045350.553063:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045350.553297:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873835136 00000100:00100000:1.0:1784045350.553311:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873835136 00000100:00100000:1.0:1784045350.553403:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784045350.553419:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873835136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045350.553485:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1784045350.553571:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045350.556089:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045350.556090:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873835136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2660us (3023us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045350.556119:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784045350.556406:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873835008 00000100:00100000:1.0:1784045350.556416:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873835008 00000100:00080000:2.0:1784045350.556486:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045350.556595:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784045350.556605:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873835008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045350.556638:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045350.556758:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873835008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 154us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045350.556764:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1784045350.556852:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf434380 x1870706873835008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045350.556938:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873835008:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1784045350.557097:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915c3b80 x1870706873835136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045350.557112:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873835136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784045350.873231:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045350.975858:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045350.975916:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863263104 00000100:00100000:3.0:1784045350.976207:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863263104 00000100:00100000:3.0:1784045350.976340:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 316 00000100:00100000:3.0:1784045350.976360:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:6167:x1870706863263104:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045350.976390:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045350.976418:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc2171000/0x5475624df454c6ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73ee3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045350.976509:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc2171000/0x5475624df454c6ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee3e expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045350.976524:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc2171000/0x5475624df454c6ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee3e expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045350.976593:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171000, rc 0) 00000100:00100000:2.0:1784045350.979041:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:6167:x1870706863263104:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 2668us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045350.979055:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 316 00000100:00100000:2.0:1784045350.983433:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045350.983648:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863263232 00000100:00100000:3.0:1784045350.983662:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863263232 00000100:00100000:3.0:1784045350.983737:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 317 00000100:00100000:3.0:1784045350.983748:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:6167:x1870706863263232:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045350.984738:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:6167:x1870706863263232:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 985us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045350.984750:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 317 00000100:00100000:1.0:1784045350.990288:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045350.990403:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863263360 00000100:00100000:2.0:1784045350.990416:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863263360 00000100:00100000:2.0:1784045350.990637:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 318 00000100:00100000:2.0:1784045350.990652:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:6167:x1870706863263360:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045350.990869:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:6167:x1870706863263360:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 220us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045350.990877:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 318 00000100:00100000:2.0:1784045351.006295:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045351.006513:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863263488 00000100:00100000:0.0:1784045351.006526:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863263488 00000100:00100000:0.0:1784045351.006594:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 319 00000100:00100000:0.0:1784045351.006605:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:6167:x1870706863263488:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045351.006641:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045351.006665:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915abc00/0x5475624df454c6f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73ee45 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045351.006712:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915abc00/0x5475624df454c6f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee45 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045351.006725:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915abc00/0x5475624df454c6f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee45 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045351.006736:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915abc00, rc 0) 00000100:00100000:0.0:1784045351.006810:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:6167:x1870706863263488:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 207us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045351.006818:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 319 00000100:00100000:0.0:1784045351.024128:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045351.024437:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863263616 00000100:00100000:1.0:1784045351.024475:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863263616 00000100:00100000:1.0:1784045351.024549:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 320 00000100:00100000:1.0:1784045351.024562:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:6167:x1870706863263616:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045351.024782:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:6167:x1870706863263616:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 222us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045351.024791:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 320 00000100:00100000:0.0:1784045351.038698:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045351.038760:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863263744 00000100:00100000:0.0:1784045351.038773:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863263744 00000100:00100000:0.0:1784045351.038841:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 321 00000100:00100000:0.0:1784045351.038854:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:6167:x1870706863263744:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045351.039383:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:6167:x1870706863263744:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 527us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045351.039393:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 321 00000100:00100000:0.0:1784045351.061806:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873835264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045351.061905:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045351.061991:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873835264 00000100:00100000:1.0:1784045351.062002:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873835264 00000100:00100000:1.0:1784045351.062118:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784045351.062131:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873835264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784045351.062172:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784045351.062236:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873835264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045351.062244:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784045351.062561:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873835264:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784045351.891644:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784045351.961504:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784045351.961512:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939b82301000 from 7 10000000:01000000:2.0:1784045351.961517:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784045351.961563:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045351.961575:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045351.961596:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045351.961626:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf50b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873835392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784045351.964035:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045351.964114:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c878e16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045351.967967:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873835392 00000100:00100000:3.0:1784045351.968054:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873835392 00000100:00100000:3.0:1784045351.968127:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1784045351.968137:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873835392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045351.968152:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045351.968170:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc2171600/0x5475624df454c701 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c6fa expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.968198:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc2171600/0x5475624df454c701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c6fa expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.968209:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc2171600/0x5475624df454c701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c6fa expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.968218:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171600, rc 0) 00000100:00100000:3.0:1784045351.968292:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873835392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (4263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045351.968298:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1784045351.968357:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf50b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873835392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045351.968377:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c701 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.968387:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c701 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045351.968478:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873835520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.968511:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045351.968531:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fd08b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045351.968545:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873835520 00000100:00100000:3.0:1784045351.968555:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873835520 00000100:00100000:3.0:1784045351.968578:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1784045351.968584:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873835520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.968703:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873835520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045351.968710:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1784045351.968743:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873835520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.968770:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873835648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.968810:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045351.968824:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fd08b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045351.968834:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873835648 00000100:00100000:3.0:1784045351.968837:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873835648 00000100:00100000:3.0:1784045351.968857:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1784045351.968862:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873835648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.968948:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873835648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045351.968955:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1784045351.971590:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873835648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784045351.973218:0:13235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784045351.973916:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784045351.973942:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045351.973952:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c701 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.973964:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c701 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045351.973985:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784045351.973987:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939cc10ba000 from 7 10000000:01000000:3.0:1784045351.973990:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045351.974091:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.974100:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.974111:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045351.974132:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873835776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.974189:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045351.974227:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc1268900 going to sleep for 11 seconds 00000100:00100000:1.0:1784045351.974290:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873835776 00000100:00100000:1.0:1784045351.974298:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873835776 00000100:00100000:1.0:1784045351.974371:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1784045351.974379:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873835776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045351.974392:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045351.974404:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b836cc200/0x5475624df454c70f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c708 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045351.974425:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836cc200/0x5475624df454c70f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c708 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045351.974473:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b836cc200/0x5475624df454c70f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c708 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045351.974483:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cc200, rc 0) 00000100:00100000:1.0:1784045351.974520:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873835776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045351.974527:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1784045351.974624:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873835776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045351.974637:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c70f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045351.974646:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c70f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045351.974710:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873835904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045351.974734:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045351.976490:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c878e16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045351.977094:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873835904 00000100:00100000:3.0:1784045351.977103:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873835904 00000100:00100000:3.0:1784045351.977143:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1784045351.977151:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873835904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.977299:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873835904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (2563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045351.977308:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1784045351.977371:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873835904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.977419:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.977486:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045351.977503:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc1268f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045351.977520:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873836032 00000100:00100000:3.0:1784045351.977525:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873836032 00000100:00100000:3.0:1784045351.977542:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1784045351.977548:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873836032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.977624:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873836032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045351.977630:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1784045351.977668:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784045351.978311:0:13236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784045351.978365:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784045351.978385:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045351.978394:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c70f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.978405:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c70f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045351.978415:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784045351.978418:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939c9157c000 from 7 10000000:01000000:3.0:1784045351.978420:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045351.978464:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.978471:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.978479:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045351.978495:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.978543:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045351.978561:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc1268f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045351.978576:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873836160 00000100:00100000:3.0:1784045351.978581:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873836160 00000100:00100000:3.0:1784045351.978603:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1784045351.978609:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873836160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045351.978618:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045351.978629:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc2171800/0x5475624df454c71d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c716 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.978650:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc2171800/0x5475624df454c71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c716 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.978660:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc2171800/0x5475624df454c71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c716 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.978668:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171800, rc 0) 00000100:00100000:3.0:1784045351.978714:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873836160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045351.978720:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1784045351.978756:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045351.978769:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c71d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045351.978778:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c71d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045351.978825:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.978858:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045351.978869:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc1268f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045351.978879:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873836288 00000100:00100000:3.0:1784045351.978882:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873836288 00000100:00100000:3.0:1784045351.978897:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1784045351.978901:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873836288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.978974:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873836288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045351.978980:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1784045351.979004:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.979027:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.979066:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045351.979079:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc1268f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045351.979089:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873836416 00000100:00100000:3.0:1784045351.979092:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873836416 00000100:00100000:3.0:1784045351.979108:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1784045351.979113:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873836416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045351.979193:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873836416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045351.979199:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1784045351.979237:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784045351.989121:0:13237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784045351.999741:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784045351.999777:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784045351.999788:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c71d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045351.999801:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c71d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045352.013859:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784045352.013865:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939c9775c000 from 7 10000000:01000000:1.0:1784045352.013871:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784045352.013911:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045352.013925:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045352.013935:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045352.013961:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045352.014037:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045352.014084:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be600 going to sleep for 11 seconds 00000100:00100000:3.0:1784045352.014144:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873836544 00000100:00100000:3.0:1784045352.014151:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873836544 00000100:00100000:3.0:1784045352.014209:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1784045352.014218:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873836544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045352.014239:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045352.014251:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc2170200/0x5475624df454c72b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c724 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045352.014274:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc2170200/0x5475624df454c72b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c724 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045352.014283:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc2170200/0x5475624df454c72b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c724 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045352.014292:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2170200, rc 0) 00000100:00100000:3.0:1784045352.014330:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873836544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045352.014337:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1784045352.014422:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045352.014437:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c72b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045352.014475:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c72b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045352.014553:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045352.014580:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045352.014604:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be600 going to sleep for 11 seconds 00000100:00100000:3.0:1784045352.014661:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873836672 00000100:00100000:3.0:1784045352.014666:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873836672 00000100:00100000:3.0:1784045352.014704:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1784045352.014711:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873836672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045352.014817:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873836672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045352.014825:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1784045352.014893:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045352.014918:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045352.014959:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045352.014981:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be600 going to sleep for 11 seconds 00000100:00100000:3.0:1784045352.015019:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873836800 00000100:00100000:3.0:1784045352.015023:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873836800 00000100:00100000:3.0:1784045352.015053:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1784045352.015060:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873836800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045352.015137:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873836800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045352.015153:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1784045352.015228:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf434e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873836800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784045352.016042:0:13246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784045352.021576:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784045352.021614:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045352.021626:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c72b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045352.021638:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c72b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045352.128269:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045352.131168:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045352.131208:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045352.131236:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863264128 00000100:00100000:1.0:1784045352.131246:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863264128 00000100:00100000:1.0:1784045352.131299:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863264384 00000100:00100000:1.0:1784045352.131302:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863264384 00000100:00100000:1.0:1784045352.131325:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 200 00000100:00100000:1.0:1784045352.131343:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863264128:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045352.131415:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863264128:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 73us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045352.131423:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 200 00000100:00100000:1.0:1784045352.131475:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 201 00000100:00100000:1.0:1784045352.131483:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863264384:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045352.131510:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863264384:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045352.131517:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 201 00000100:00080000:1.0:1784045352.131536:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045352.131918:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863263872 00000100:00100000:2.0:1784045352.131922:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863263872 00000100:00100000:2.0:1784045352.131963:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 334 00000100:00100000:2.0:1784045352.131969:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863263872:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045352.131999:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863263872:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 31us (3742us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045352.132006:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 334 00000100:00100000:1.0:1784045352.135851:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045352.135886:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045352.135909:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863264000 00000100:00100000:1.0:1784045352.135918:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863264000 00000100:00100000:1.0:1784045352.135969:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863264256 00000100:00100000:1.0:1784045352.135973:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863264256 00000100:00100000:1.0:1784045352.135997:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 202 00000100:00100000:1.0:1784045352.136007:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863264000:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045352.136082:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863264000:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 76us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045352.136089:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 202 00000100:00100000:1.0:1784045352.136112:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 203 00000100:00100000:1.0:1784045352.136119:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863264256:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045352.136144:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863264256:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045352.136160:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 203 00000100:00080000:1.0:1784045352.136184:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045352.595647:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045352.595675:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873836928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045352.595756:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045352.595826:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873836928 00000100:00100000:0.0:1784045352.595833:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873836928 00000100:00100000:0.0:1784045352.595884:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784045352.595893:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873836928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784045352.595929:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1784045352.595974:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873836928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045352.595982:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784045352.596028:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873836928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045352.596653:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873837184:0@lo:400:kworker.0 00000100:00100000:0.0:1784045352.596705:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045352.596738:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873837696:0@lo:400:kworker.0 00000100:00100000:0.0:1784045352.596763:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045352.596784:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873838208:0@lo:400:kworker.0 00000100:00100000:0.0:1784045352.596802:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045352.596822:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784045352.596828:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873837312:0@lo:400:kworker.0 00000100:00100000:0.0:1784045352.596847:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045352.596863:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873837824:0@lo:400:kworker.0 00000100:00100000:0.0:1784045352.596879:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045352.596892:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873838336:0@lo:400:kworker.0 00000100:00100000:0.0:1784045352.596928:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045352.596959:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873837184 00000100:00100000:0.0:1784045352.596965:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873837184 00000100:00100000:0.0:1784045352.597000:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1784045352.597008:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873837184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045352.597050:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873837184:12345-0@lo:400:kworker.0 Request processed in 43us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045352.597058:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1784045352.597075:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873837696 00000100:00100000:0.0:1784045352.597079:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873837696 00000100:00100000:0.0:1784045352.597105:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873838208 00000100:00100000:0.0:1784045352.597109:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873838208 00000100:00100000:0.0:1784045352.597121:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873837824 00000100:00100000:0.0:1784045352.597123:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873837824 00000100:00100000:0.0:1784045352.597135:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873838336 00000100:00100000:0.0:1784045352.597137:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873838336 00000100:00100000:0.0:1784045352.597150:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784045352.597156:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873837696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045352.597239:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873837696:12345-0@lo:400:kworker.0 Request processed in 82us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045352.597245:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784045352.597257:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784045352.597264:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873838208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045352.597299:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873838208:12345-0@lo:400:kworker.0 Request processed in 36us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045352.597305:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784045352.597317:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784045352.597322:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873837824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045352.597381:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873837824:12345-0@lo:400:kworker.0 Request processed in 40us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045352.597387:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784045352.597397:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784045352.597403:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873838336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045352.597463:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873838336:12345-0@lo:400:kworker.0 Request processed in 39us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045352.597470:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784045352.597494:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873837312 00000100:00100000:0.0:1784045352.597498:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873837312 00000100:00100000:0.0:1784045352.597523:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784045352.597529:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873837312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045352.597563:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873837312:12345-0@lo:400:kworker.0 Request processed in 34us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045352.597575:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1784045352.597599:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045352.597603:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045352.597640:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873837312:0@lo:400:kworker.0 00010000:00080000:0.0:1784045352.597653:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b836d3b80 x1870706873837824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045352.597663:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873837824:0@lo:400:kworker.0 00010000:00080000:0.0:1784045352.597673:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b836d3100 x1870706873838336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045352.597693:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873838336:0@lo:400:kworker.0 00000100:00100000:0.0:1784045352.597704:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873837184:0@lo:400:kworker.0 00010000:00080000:0.0:1784045352.597722:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b836d1880 x1870706873837696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045352.597730:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873837696:0@lo:400:kworker.0 00010000:00080000:0.0:1784045352.597739:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b836d0700 x1870706873838208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045352.597746:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873838208:0@lo:400:kworker.0 00000100:00100000:2.0:1784045352.597862:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873837440:0@lo:400:kworker.0 00000100:00100000:2.0:1784045352.597904:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045352.597942:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873837952:0@lo:400:kworker.0 00000100:00100000:2.0:1784045352.597962:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045352.597983:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784045352.597990:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873837056:0@lo:400:kworker.0 00000100:00100000:2.0:1784045352.598012:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045352.598029:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873837568:0@lo:400:kworker.0 00000100:00100000:2.0:1784045352.598047:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045352.598063:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873838080:0@lo:400:kworker.0 00000100:00100000:2.0:1784045352.598081:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045352.598102:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873837440 00000100:00100000:2.0:1784045352.598106:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873837440 00000100:00100000:2.0:1784045352.598135:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873837952 00000100:00100000:2.0:1784045352.598138:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873837952 00000100:00100000:2.0:1784045352.598149:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873837056 00000100:00100000:2.0:1784045352.598151:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873837056 00000100:00100000:2.0:1784045352.598161:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873837568 00000100:00100000:2.0:1784045352.598164:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873837568 00000100:00100000:2.0:1784045352.598175:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873838080 00000100:00100000:2.0:1784045352.598177:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873838080 00000100:00100000:2.0:1784045352.598190:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1784045352.598196:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873837440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045352.598237:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873837440:12345-0@lo:400:kworker.0 Request processed in 41us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045352.598244:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1784045352.598258:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1784045352.598265:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873837952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045352.598304:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873837952:12345-0@lo:400:kworker.0 Request processed in 39us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045352.598310:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1784045352.598321:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1784045352.598327:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873837056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045352.598354:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873837056:12345-0@lo:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045352.598360:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1784045352.598371:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784045352.598376:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873837568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045352.598402:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873837568:12345-0@lo:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045352.598408:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1784045352.598418:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1784045352.598424:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873838080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045352.598488:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873838080:12345-0@lo:400:kworker.0 Request processed in 63us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045352.598494:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:2.0:1784045352.598524:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045352.598527:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045352.598550:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873837056:0@lo:400:kworker.0 00010000:00080000:2.0:1784045352.598561:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b8357a300 x1870706873837568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045352.598570:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873837568:0@lo:400:kworker.0 00010000:00080000:2.0:1784045352.598590:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b836d0000 x1870706873838080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045352.598599:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873838080:0@lo:400:kworker.0 00000100:00100000:2.0:1784045352.598609:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873837440:0@lo:400:kworker.0 00000100:00100000:2.0:1784045352.598617:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873837952:0@lo:400:kworker.0 00010000:00010000:1.0:1784045352.918927:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045353.112572:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873838464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045353.112644:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045353.112725:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045353.112732:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873838592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045353.112755:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045353.112788:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873838464 00000100:00100000:3.0:1784045353.112794:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873838464 00000100:00100000:3.0:1784045353.112837:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873838592 00000100:00100000:3.0:1784045353.112840:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873838592 00000100:00100000:3.0:1784045353.112854:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784045353.112861:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873838464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784045353.112890:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045353.112930:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873838464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045353.112937:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784045353.112953:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784045353.112958:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873838592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784045353.112968:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045353.112998:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873838592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045353.113004:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1784045353.113042:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c91561f80 x1870706873838592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045353.113061:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873838592:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1784045353.113071:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf50b800 x1870706873838464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045353.113081:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf50b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873838464:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1784045353.787360:0:13363:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784045353.940713:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045354.964588:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045355.669149:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045355.669184:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873838720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045355.669256:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045355.669436:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873838720 00000100:00100000:3.0:1784045355.669471:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873838720 00000100:00100000:3.0:1784045355.669527:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784045355.669537:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873838720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045355.669566:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045355.669617:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873838720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045355.669624:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1784045355.669675:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915c1880 x1870706873838720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045355.669694:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873838720:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784045355.669769:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045355.669976:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045355.669987:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873838848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045355.670024:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045355.670100:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873838848 00000100:00100000:3.0:1784045355.670105:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873838848 00000100:00100000:3.0:1784045355.670144:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784045355.670150:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873838848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784045355.670188:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045355.670224:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873838848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045355.670230:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1784045355.670255:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915c1880 x1870706873838848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045355.670268:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873838848:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784045355.670390:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784045355.987807:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045356.179685:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045356.179708:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873838976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045356.179776:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045356.179876:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873838976 00000100:00100000:0.0:1784045356.179883:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873838976 00000100:00100000:0.0:1784045356.179944:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784045356.179953:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873838976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045356.179985:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045356.180031:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873838976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045356.180038:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784045356.180264:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873838976:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784045357.011680:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045357.251703:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045357.251846:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045357.256836:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045357.256879:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045357.258483:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863264640 00000100:00100000:0.0:1784045357.258499:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863264640 00000100:00100000:0.0:1784045357.258611:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863264896 00000100:00100000:0.0:1784045357.258628:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863264896 00000100:00100000:0.0:1784045357.258677:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 210 00000100:00100000:0.0:1784045357.258690:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863264640:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045357.258823:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863264640:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 134us (7134us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045357.258832:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 210 00000100:00100000:0.0:1784045357.258854:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 211 00000100:00100000:0.0:1784045357.258864:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863264896:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045357.258903:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863264896:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 41us (7056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045357.258912:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 211 00000100:00080000:0.0:1784045357.258933:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045357.261387:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045357.261430:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863264512 00000100:00100000:1.0:1784045357.261465:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863264512 00000100:00100000:1.0:1784045357.261543:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 335 00000100:00100000:1.0:1784045357.261556:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863264512:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045357.261643:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863264512:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 89us (4821us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045357.261661:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 335 00000100:00100000:0.0:1784045357.261783:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863264768 00000100:00100000:0.0:1784045357.261790:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863264768 00000100:00100000:0.0:1784045357.261841:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863265024 00000100:00100000:0.0:1784045357.261845:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863265024 00000100:00100000:1.0:1784045357.261856:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 212 00000100:00100000:1.0:1784045357.261868:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863264768:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045357.261875:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 213 00000100:00100000:0.0:1784045357.261886:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863265024:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045357.261921:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863264768:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 50us (5035us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045357.261929:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863265024:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 43us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045357.261935:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 212 00000100:00100000:0.0:1784045357.261952:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 213 00000100:00080000:0.0:1784045357.261977:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045357.715777:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873839104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045357.715877:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045357.716563:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873839104 00000100:00100000:0.0:1784045357.716575:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873839104 00000100:00100000:0.0:1784045357.716645:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784045357.716666:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873839104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784045357.716714:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784045357.716953:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873839488:0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.717012:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045357.717046:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873840000:0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.717072:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045357.717098:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873840512:0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.717121:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045357.717143:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784045357.717149:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873839616:0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.717172:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045357.717190:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873840128:0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.717211:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045357.717228:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873840640:0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.717248:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045357.717280:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873839488 00000100:00100000:1.0:1784045357.717285:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873839488 00000100:00100000:0.0:1784045357.717512:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873839104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 848us (1634us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045357.717543:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784045357.717569:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873839616 00000100:00100000:0.0:1784045357.717572:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873839616 00000100:00100000:3.0:1784045357.717592:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873839232:0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.717598:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784045357.717604:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873839616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045357.717632:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045357.717642:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873839616:12345-0@lo:400:kworker.0 Request processed in 39us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045357.717661:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784045357.717668:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873839744:0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.717680:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873840000 00000100:00100000:0.0:1784045357.717683:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873840000 00000100:00100000:3.0:1784045357.717693:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045357.717710:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873840256:0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.717717:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873840512 00000100:00100000:0.0:1784045357.717720:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873840512 00000100:00100000:3.0:1784045357.717730:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045357.717749:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1784045357.717754:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873839360:0@lo:400:kworker.0 00000100:00100000:3.0:1784045357.717776:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045357.717794:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873839872:0@lo:400:kworker.0 00000100:00100000:3.0:1784045357.717814:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045357.717824:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873840384:0@lo:400:kworker.0 00000100:00100000:3.0:1784045357.717843:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045357.717863:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873839744 00000100:00100000:3.0:1784045357.717866:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873839744 00000100:00100000:2.0:1784045357.717960:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c8820ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873839104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045357.718017:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873840128 00000100:00100000:2.0:1784045357.718021:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873840128 00000100:00100000:2.0:1784045357.718041:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873840640 00000100:00100000:2.0:1784045357.718043:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873840640 00000100:00100000:0.0:1784045357.718080:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784045357.718086:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873840000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.718138:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873840000:12345-0@lo:400:kworker.0 Request processed in 52us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045357.718144:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784045357.718156:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784045357.718161:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873840128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.718186:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873840128:12345-0@lo:400:kworker.0 Request processed in 25us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045357.718207:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784045357.718219:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784045357.718894:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873840256 00000100:00100000:1.0:1784045357.718901:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873840256 00000100:00100000:1.0:1784045357.719351:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873839360 00000100:00100000:1.0:1784045357.719355:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873839360 00000100:00100000:1.0:1784045357.719371:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873839872 00000100:00100000:1.0:1784045357.719374:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873839872 00000100:00100000:1.0:1784045357.719389:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873840384 00000100:00100000:1.0:1784045357.719392:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873840384 00000100:00100000:1.0:1784045357.719409:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1784045357.719418:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873839488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.719519:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873839488:12345-0@lo:400:kworker.0 Request processed in 101us (2506us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045357.719544:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1784045357.719568:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1784045357.719575:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873840256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.719621:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873840256:12345-0@lo:400:kworker.0 Request processed in 47us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045357.719628:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1784045357.719641:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1784045357.719656:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873839360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.719685:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873839360:12345-0@lo:400:kworker.0 Request processed in 40us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045357.719691:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1784045357.719704:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1784045357.719711:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873839872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.719738:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873839872:12345-0@lo:400:kworker.0 Request processed in 28us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045357.719744:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1784045357.719756:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784045357.719761:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873840384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.719790:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873840384:12345-0@lo:400:kworker.0 Request processed in 29us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045357.719796:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784045357.719837:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873839232 00000100:00100000:1.0:1784045357.719842:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873839232 00000100:00100000:1.0:1784045357.719882:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1784045357.719890:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873839232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.719944:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873839232:12345-0@lo:400:kworker.0 Request processed in 55us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045357.719950:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1784045357.720035:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873839360:0@lo:400:kworker.0 00010000:00080000:1.0:1784045357.720052:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83381180 x1870706873839872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045357.720063:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873839872:0@lo:400:kworker.0 00010000:00080000:1.0:1784045357.720075:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83381f80 x1870706873840384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045357.720083:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873840384:0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.720092:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873839232:0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.720103:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873840256:0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.720145:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873839616:0@lo:400:kworker.0 00010000:00080000:1.0:1784045357.720159:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83380380 x1870706873840128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045357.720167:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83380380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873840128:0@lo:400:kworker.0 00000100:00100000:1.0:1784045357.720179:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873839488:0@lo:400:kworker.0 00010000:00080000:1.0:1784045357.720190:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83381500 x1870706873840000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045357.720198:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873840000:0@lo:400:kworker.0 00000100:00080000:1.0:1784045357.720259:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784045357.720276:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045357.720279:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045357.720370:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1784045357.720378:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873839744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045357.720438:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873839744:12345-0@lo:400:kworker.0 Request processed in 61us (2743us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045357.720458:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1784045357.720487:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873839744:0@lo:400:kworker.0 00000100:00100000:2.0:1784045357.720950:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784045357.720959:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873840640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045357.721015:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873840640:12345-0@lo:400:kworker.0 Request processed in 57us (3765us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045357.721021:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:2.0:1784045357.721073:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83381c00 x1870706873840640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045357.721084:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873840640:0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.724220:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873840512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045357.724374:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873840512:12345-0@lo:400:kworker.0 Request processed in 6148us (7251us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045357.724406:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1784045357.724517:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045357.724523:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784045357.724913:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83383100 x1870706873840512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045357.724932:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873840512:0@lo:400:kworker.0 00010000:00010000:1.0:1784045358.035591:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045358.227716:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045358.227740:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873840768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045358.227825:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045358.228043:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873840768 00000100:00100000:1.0:1784045358.228053:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873840768 00000100:00100000:1.0:1784045358.228111:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784045358.228122:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873840768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784045358.228151:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045358.228203:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873840768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045358.228210:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:1.0:1784045358.228256:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82379c00 x1870706873840768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045358.228272:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873840768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045358.237682:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873840896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045358.237753:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045358.237830:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873840896 00000100:00100000:1.0:1784045358.237838:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873840896 00000100:00100000:1.0:1784045358.237880:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784045358.237888:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873840896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045358.237913:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045358.237960:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873840896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045358.237968:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1784045358.238015:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b8357a300 x1870706873840896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045358.238049:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8357a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873840896:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1784045358.650138:0:13512:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:09:16 (1784045356) === 00000100:00100000:1.0:1784045358.860590:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045358.860694:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045358.860843:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863265280 00000100:00100000:2.0:1784045358.860855:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863265280 00000100:00100000:2.0:1784045358.860925:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:2.0:1784045358.860936:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:10493:x1870706863265280:12345-192.168.203.44@tcp:700:mkdir.0 00000100:00100000:2.0:1784045358.861042:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:10493:x1870706863265280:12345-192.168.203.44@tcp:700:mkdir.0 Request processed in 107us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045358.861051:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:0.0:1784045358.862344:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863265152 00000100:00100000:0.0:1784045358.862353:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863265152 00000100:00100000:1.0:1784045358.864438:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:1.0:1784045358.864468:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863265152:12345-192.168.203.44@tcp:41:mkdir.0 00000004:00000024:1.0:1784045358.864505:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784045358.864601:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863265152:12345-192.168.203.44@tcp:41:mkdir.0 Request processed in 136us (4021us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045358.864609:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:1.0:1784045358.874770:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045358.874867:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863265536 00000100:00100000:3.0:1784045358.874877:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863265536 00000100:00100000:3.0:1784045358.874949:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:3.0:1784045358.874958:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:10493:x1870706863265536:12345-192.168.203.44@tcp:36:mkdir.0 00010000:00010000:3.0:1784045358.875013:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045358.875088:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c5d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edb9 expref: 6 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.875108:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c813ee300) 00010000:00010000:3.0:1784045358.875119:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045358.875221:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454c732 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.875235:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454c732 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.875245:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454c732 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.875257:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454c739 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.875264:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454c739 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.875301:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454c739 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.878927:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c740 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.878952:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c740 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.878967:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c740 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045358.879004:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004c494ffb reply state 0000000033973af9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c740 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.879016:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c740 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.879024:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b8310c000) 00010000:00010000:2.0:1784045358.879026:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784045358.879031:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784045358.879047:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784045358.879056:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454c732 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.879063:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454c732 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.879070:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454c732 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.879076:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045358.879081:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454c732 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.879089:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454c732 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.879100:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93aa0000) 00010000:00010000:2.0:1784045358.879102:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045358.879106:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454c732 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.879112:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454c732 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045358.879134:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004c494ffb reply state 0000000033973af9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454c739 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.879143:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454c739 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.879263:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff939c93aa0200) 00010000:00010000:2.0:1784045358.879266:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784045358.879274:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1784045358.879611:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:10493:x1870706863265536:12345-192.168.203.44@tcp:36:mkdir.0 Request processed in 4649us (4845us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784045358.879620:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:0.0:1784045358.908154:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045358.908373:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863265664 00000100:00100000:3.0:1784045358.908384:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863265664 00000100:00100000:3.0:1784045358.908472:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:3.0:1784045358.908484:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:10494:x1870706863265664:12345-192.168.203.44@tcp:101:chmod.0 00010000:00010000:3.0:1784045358.908509:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045358.908532:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454c747 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ee4c expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.908608:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454c74e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.908621:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454c74e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.908634:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454c74e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045358.908685:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784045358.908690:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784045358.908723:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454c74e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.908749:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454c747 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee4c expref: 9 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.908766:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454c74e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee4c expref: 8 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.908787:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93aa0800) 00010000:00010000:3.0:1784045358.908790:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045358.908793:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106ea00, rc 0) 00000100:00100000:3.0:1784045358.908858:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:10494:x1870706863265664:12345-192.168.203.44@tcp:101:chmod.0 Request processed in 377us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045358.908865:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:3.0:1784045358.911042:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045358.911355:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863265920 00000100:00100000:2.0:1784045358.911364:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863265920 00000100:00100000:2.0:1784045358.911588:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:2.0:1784045358.911598:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:10494:x1870706863265920:12345-192.168.203.44@tcp:36:chmod.0 00010000:00010000:2.0:1784045358.911657:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045358.911681:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454c74e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee4c expref: 8 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.911700:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93aa0800) 00010000:00010000:2.0:1784045358.911789:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045358.911818:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c755 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.911830:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.911840:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045358.912049:0:6498:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004e5d8808 reply state 00000000373c8193 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c755 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.912073:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c755 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045358.912080:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:2.0:1784045358.912089:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1784045358.912092:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784045358.912101:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784045358.912194:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:10494:x1870706863265920:12345-192.168.203.44@tcp:36:chmod.0 Request processed in 596us (1159us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784045358.912202:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:2.0:1784045358.964219:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045358.965054:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863266048 00000100:00100000:3.0:1784045358.965065:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863266048 00000100:00100000:3.0:1784045358.965131:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:3.0:1784045358.965142:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:10495:x1870706863266048:12345-192.168.203.44@tcp:101:chown.0 00010000:00010000:3.0:1784045358.965164:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045358.965184:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454c75c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ee53 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.965248:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454c763 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.965263:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454c763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.965274:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454c763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045358.965329:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784045358.965332:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784045358.965364:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454c763 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.965404:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454c75c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee53 expref: 11 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.965424:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454c763 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee53 expref: 10 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045358.965432:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:3.0:1784045358.965435:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045358.965438:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106ea00, rc 0) 00000100:00100000:3.0:1784045358.965633:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:10495:x1870706863266048:12345-192.168.203.44@tcp:101:chown.0 Request processed in 492us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045358.965649:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:0.0:1784045358.975592:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045358.976064:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863266176 00000100:00100000:1.0:1784045358.976075:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863266176 00000100:00100000:1.0:1784045358.976195:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:1.0:1784045358.976206:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:10495:x1870706863266176:12345-192.168.203.44@tcp:101:chown.0 00010000:00010000:1.0:1784045358.976226:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045358.976250:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c76a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ee5a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976333:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c771 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976347:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c771 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976361:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c771 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976391:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c778 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976399:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976405:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976505:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836ccc00/0x5475624df454c77f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976514:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836ccc00/0x5475624df454c77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976520:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836ccc00/0x5475624df454c77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045358.976560:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784045358.976564:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784045358.976596:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b836ccc00/0x5475624df454c77f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976617:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c771 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976625:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c771 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976632:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c771 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976658:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045358.976663:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c771 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976670:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c771 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976683:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:1.0:1784045358.976685:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045358.976690:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c771 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976696:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c771 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976709:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c778 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976715:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c778 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976721:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c778 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976726:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045358.976729:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c778 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976735:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c778 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976753:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff939c93aa0200) 00010000:00010000:1.0:1784045358.976756:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045358.976759:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c778 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976765:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c778 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976790:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c76a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee5a expref: 12 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976801:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836ccc00/0x5475624df454c77f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee5a expref: 11 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.976808:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b8310c000) 00010000:00010000:1.0:1784045358.977006:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045358.977012:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836ccc00, rc 0) 00000100:00100000:1.0:1784045358.977087:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:10495:x1870706863266176:12345-192.168.203.44@tcp:101:chown.0 Request processed in 882us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045358.977095:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:2.0:1784045358.984206:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045358.984289:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863266304 00000100:00100000:1.0:1784045358.984299:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863266304 00000100:00100000:1.0:1784045358.984357:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:1.0:1784045358.984369:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:10495:x1870706863266304:12345-192.168.203.44@tcp:900:chown.0 00000100:00100000:1.0:1784045358.984481:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:10495:x1870706863266304:12345-192.168.203.44@tcp:900:chown.0 Request processed in 114us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045358.984490:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:3.0:1784045358.988206:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045358.988303:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863266560 00000100:00100000:0.0:1784045358.988319:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863266560 00000100:00100000:0.0:1784045358.988390:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:0.0:1784045358.988401:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:10495:x1870706863266560:12345-192.168.203.44@tcp:36:chown.0 00010000:00010000:0.0:1784045358.988491:0:10615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045358.988520:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836ccc00/0x5475624df454c77f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee5a expref: 11 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045358.988547:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b8310c000) 00010000:00010000:0.0:1784045358.988552:0:10615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045358.988578:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c786 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045358.988593:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c786 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045358.988603:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c786 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045358.998554:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:1.0:1784045358.999292:0:10615:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007a5051ea reply state 000000005c4ca778 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c786 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.999323:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c786 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045358.999334:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b8310c000) 00010000:00010000:1.0:1784045358.999338:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1784045358.999342:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784045358.999358:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784045359.000885:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454c739 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.000916:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454c739 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.000925:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454c739 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.000932:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2170a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045359.000937:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454c739 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.000945:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454c739 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.000961:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff939c93aa0200) 00010000:00010000:0.0:1784045359.000964:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045359.000970:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454c739 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.000976:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454c739 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001001:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c740 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001007:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c740 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001013:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c740 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001017:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045359.001027:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c740 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001033:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c740 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001042:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b8310c000) 00010000:00010000:0.0:1784045359.001045:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045359.001048:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c740 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001054:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c740 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001070:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c755 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001076:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c755 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001082:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c755 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001087:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045359.001090:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c755 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001097:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c755 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001105:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:0.0:1784045359.001107:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784045359.001117:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c755 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.001123:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c755 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1784045359.002557:0:10615:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1784045359.002606:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:10495:x1870706863266560:12345-192.168.203.44@tcp:36:chown.0 Request processed in 14194us (14403us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1784045359.002619:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 28 00010000:00010000:3.0:1784045359.006419:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c786 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.006439:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c786 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.006503:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c786 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.006511:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aae00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045359.006517:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c786 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.006527:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c786 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.006568:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b8310c000) 00010000:00010000:3.0:1784045359.006572:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784045359.006578:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c786 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.006584:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c786 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045359.032731:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045359.042514:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863266688 00000100:00100000:0.0:1784045359.042529:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863266688 00000100:00100000:1.0:1784045359.042781:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:1.0:1784045359.042796:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:10496:x1870706863266688:12345-192.168.203.44@tcp:101:touch.500 00010000:00010000:1.0:1784045359.042820:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045359.042843:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c78d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ee61 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784045359.043025:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1784045359.044417:0:6498:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1521us 00010000:00010000:2.0:1784045359.064797:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045359.085667:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c794 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.085689:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c794 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.085701:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c794 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.085716:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c79b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.085732:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c79b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.085739:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c79b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.085836:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c7a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.085844:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.085852:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045359.085881:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784045359.085885:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784045359.086665:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c7a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086689:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c794 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086696:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c794 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086703:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c794 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086709:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045359.086712:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c794 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086730:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c794 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086744:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:1.0:1784045359.086747:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045359.086751:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c794 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086758:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc600/0x5475624df454c794 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086772:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c79b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086778:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c79b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086784:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c79b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086789:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045359.086792:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c79b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086797:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c79b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086804:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff939b81924e00) 00010000:00010000:1.0:1784045359.086807:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045359.086810:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c79b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086824:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c79b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086867:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c78d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee61 expref: 8 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086882:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c7a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee61 expref: 7 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.086888:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b81924900) 00010000:00010000:1.0:1784045359.086891:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784045359.086893:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cce00, rc 0) 00000100:00100000:0.0:1784045359.087722:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:10496:x1870706863266688:12345-192.168.203.44@tcp:101:touch.500 Request processed in 44924us (54994us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045359.087733:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:2.0:1784045359.093010:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045359.094527:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863266944 00000100:00100000:1.0:1784045359.094541:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863266944 00000100:00100000:1.0:1784045359.094620:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:1.0:1784045359.094631:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:10496:x1870706863266944:12345-192.168.203.44@tcp:101:touch.500 00010000:00010000:1.0:1784045359.094666:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045359.094687:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd200/0x5475624df454c7a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ee68 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.094812:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c7b0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.094826:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c7b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.094837:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c7b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.094871:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454c7b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.094879:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454c7b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.094885:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454c7b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784045359.096259:0:6497:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1784045359.096632:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c7be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.096660:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c7be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.096672:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c7be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.096712:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c7b0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.096719:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c7b0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.096726:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c7b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.096733:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cca00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045359.096737:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c7b0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.096756:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c7b0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.096769:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b81924900) 00010000:00010000:0.0:1784045359.096772:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045359.096776:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c7b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.096783:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c7b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045359.096798:0:6497:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef22f192 reply state 000000000a538523 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454c7b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.096809:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454c7b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.096815:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff939b81924600) 00010000:00010000:0.0:1784045359.096818:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784045359.096821:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784045359.096860:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd200/0x5475624df454c7a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee68 expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.096875:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c7be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee68 expref: 9 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.096881:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939c813eee00) 00010000:00010000:0.0:1784045359.096883:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045359.096884:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aae00, rc 0) 00000100:00100000:0.0:1784045359.096972:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:10496:x1870706863266944:12345-192.168.203.44@tcp:101:touch.500 Request processed in 2342us (4081us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1784045359.096986:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:2.0:1784045359.107066:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045359.107159:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863267200 00000100:00100000:1.0:1784045359.107168:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863267200 00000100:00100000:1.0:1784045359.107230:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:1.0:1784045359.107240:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:10496:x1870706863267200:12345-192.168.203.44@tcp:36:touch.500 00010000:00010000:1.0:1784045359.107311:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045359.107339:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c7be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee68 expref: 10 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.107360:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939c813eee00) 00010000:00010000:1.0:1784045359.107372:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045359.107422:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c7cc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.107435:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c7cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.107487:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c7cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045359.107621:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e336eca reply state 00000000968ad6cf transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c7cc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.107635:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c7cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.107651:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939b81924e00) 00010000:00010000:1.0:1784045359.107654:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784045359.107656:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784045359.107744:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:10496:x1870706863267200:12345-192.168.203.44@tcp:36:touch.500 Request processed in 504us (684us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1784045359.107752:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:2.0:1784045359.114784:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045359.114897:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863267328 00000100:00100000:1.0:1784045359.114908:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863267328 00000100:00100000:1.0:1784045359.115126:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 32 00000100:00100000:1.0:1784045359.115138:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:10496:x1870706863267328:12345-192.168.203.44@tcp:101:touch.500 00010000:00010000:1.0:1784045359.115182:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045359.115205:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c7d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ee6f expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.115266:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c7d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee6f expref: 12 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.115282:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c7d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee6f expref: 12 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045359.115302:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939b81924e00) 00010000:00010000:1.0:1784045359.115318:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045359.115322:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cc800, rc 0) 00000100:00100000:1.0:1784045359.115382:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+12:10496:x1870706863267328:12345-192.168.203.44@tcp:101:touch.500 Request processed in 247us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045359.115390:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 32 00000100:00100000:2.0:1784045359.119782:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045359.120428:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863267456 00000100:00100000:3.0:1784045359.120626:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863267456 00000100:00100000:3.0:1784045359.120754:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:3.0:1784045359.120766:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1870706863267456:12345-192.168.203.44@tcp:8:touch.500 00010000:00080000:3.0:1784045359.120815:0:8648:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:3.0:1784045359.120865:0:8648:0:(genops.c:1406:class_connect()) connect: client bbcbf11d-b5f2-42a6-9759-7590eb85aa60, cookie 0x5475624df454c7da 00002000:00100000:3.0:1784045359.120882:0:8648:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bbcbf11d-b5f2-42a6-9759-7590eb85aa60/ffff939b833a9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784045359.120917:0:8648:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:3.0:1784045359.121019:0:8648:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784045359.121068:0:8648:0:(import.c:65:import_set_state_nolock()) ffff939b833ad000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045359.121165:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2393:x1870706863267456:12345-192.168.203.44@tcp:8:touch.500 Request processed in 399us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045359.121173:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:2.0:1784045359.125080:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045359.125259:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863267584 00000100:00100000:0.0:1784045359.125273:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863267584 00000100:00100000:0.0:1784045359.125374:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00080000:1.0:1784045359.125390:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045359.125390:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:0:x1870706863267584:12345-192.168.203.44@tcp:2:touch.500 00000001:00080000:2.0:1784045359.145172:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1784045359.145195:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000100:00100000:0.0:1784045359.145632:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:0:x1870706863267584:12345-192.168.203.44@tcp:2:touch.500 Request processed in 20237us (20556us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784045359.145657:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:1.0:1784045359.155663:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045359.155835:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863267840 00000100:00100000:2.0:1784045359.155849:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863267840 00000100:00100000:2.0:1784045359.155944:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:2.0:1784045359.155957:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+12:10496:x1870706863267840:12345-192.168.203.44@tcp:35:touch.500 00000100:00100000:2.0:1784045359.156373:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+13:10496:x1870706863267840:12345-192.168.203.44@tcp:35:touch.500 Request processed in 418us (732us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1784045359.156381:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:2.0:1784045359.208832:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045359.212267:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863267968 00000100:00100000:1.0:1784045359.212288:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863267968 00000100:00100000:2.0:1784045359.217628:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:2.0:1784045359.217689:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+13:10497:x1870706863267968:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:2.0:1784045359.217724:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045359.217753:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c7e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ee76 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.217840:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c7e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.217858:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.217882:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045359.218044:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784045359.218049:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045359.218097:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.218197:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c7e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee76 expref: 15 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.218220:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee76 expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.218230:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b81924900) 00010000:00010000:2.0:1784045359.218233:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045359.218237:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986a00, rc 0) 00000100:00100000:2.0:1784045359.218384:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:10497:x1870706863267968:12345-192.168.203.44@tcp:101:rm.0 Request processed in 711us (9567us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045359.218403:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:3.0:1784045359.241499:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045359.241636:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863268224 00000100:00100000:0.0:1784045359.241668:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863268224 00000100:00100000:0.0:1784045359.241755:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:0.0:1784045359.241767:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:10497:x1870706863268224:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:0.0:1784045359.241795:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045359.241821:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c7ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ee7d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045359.241982:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784045359.242177:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c7ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee7d expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.242194:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:0.0:1784045359.242198:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784045359.242203:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c7ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee7d expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.242220:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915abe00, rc 0) 00000100:00100000:0.0:1784045359.242316:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:10497:x1870706863268224:12345-192.168.203.44@tcp:101:rm.0 Request processed in 551us (879us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1784045359.242324:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:0.0:1784045359.247490:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045359.248076:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863268352 00000100:00100000:2.0:1784045359.248090:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863268352 00000100:00100000:3.0:1784045359.248441:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:3.0:1784045359.248483:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:10497:x1870706863268352:12345-192.168.203.44@tcp:37:rm.0 00000100:00100000:1.0:1784045359.254747:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:10497:x1870706863268352:12345-192.168.203.44@tcp:37:rm.0 Request processed in 6247us (7297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045359.254766:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:3.0:1784045359.258614:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045359.259424:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863268608 00000100:00100000:1.0:1784045359.259439:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863268608 00000100:00100000:1.0:1784045359.259561:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:1.0:1784045359.259572:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9855f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:10497:x1870706863268608:12345-192.168.203.44@tcp:35:rm.0 00000100:00100000:1.0:1784045359.259886:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9855f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:10497:x1870706863268608:12345-192.168.203.44@tcp:35:rm.0 Request processed in 314us (1288us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1784045359.259902:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:0.0:1784045359.263984:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045359.264231:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863268864 00000100:00100000:2.0:1784045359.264243:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863268864 00000100:00100000:2.0:1784045359.264326:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:2.0:1784045359.264337:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:10497:x1870706863268864:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:2.0:1784045359.264366:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045359.264391:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987c00/0x5475624df454c7fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ee84 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.264575:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454c804 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.264592:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454c804 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.264607:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454c804 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045359.264620:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784045359.264772:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987c00/0x5475624df454c7fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee84 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.264793:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454c804 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee84 expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.264803:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b81924900) 00010000:00010000:2.0:1784045359.264806:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784045359.264828:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987800, rc 0) 00000100:00100000:2.0:1784045359.264980:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:10497:x1870706863268864:12345-192.168.203.44@tcp:101:rm.0 Request processed in 580us (945us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784045359.264992:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:2.0:1784045359.269817:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045359.269930:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863268992 00000100:00100000:0.0:1784045359.269941:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863268992 00000100:00100000:0.0:1784045359.270030:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:0.0:1784045359.270041:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:10497:x1870706863268992:12345-192.168.203.44@tcp:41:rm.0 00000004:00000024:0.0:1784045359.270130:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1784045359.270227:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:10497:x1870706863268992:12345-192.168.203.44@tcp:41:rm.0 Request processed in 187us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045359.270236:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:3.0:1784045359.274438:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045359.274817:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863269120 00000100:00100000:2.0:1784045359.274831:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863269120 00000100:00100000:2.0:1784045359.275271:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 37 00000100:00100000:2.0:1784045359.275287:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:10497:x1870706863269120:12345-192.168.203.44@tcp:101:rm.0 00010000:00010000:2.0:1784045359.275324:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045359.275353:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987c00/0x5475624df454c812 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ee8b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275440:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454c819 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275502:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454c819 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275516:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454c819 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275528:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c820 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275536:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c820 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275542:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c820 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275696:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454c827 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275706:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454c827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275714:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454c827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045359.275759:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784045359.275764:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045359.275790:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454c827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275803:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454c827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275812:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454c819 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275819:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454c819 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275826:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454c819 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275833:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045359.275838:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454c819 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275847:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454c819 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275869:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b81924900) 00010000:00010000:2.0:1784045359.275872:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045359.275879:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454c819 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275886:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454c819 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275903:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c820 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.275910:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c820 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.276338:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c820 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.276348:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045359.276351:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c820 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.276358:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c820 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.276367:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff939b81924600) 00010000:00010000:2.0:1784045359.276370:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045359.276373:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c820 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.276378:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986400/0x5475624df454c820 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.276429:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987c00/0x5475624df454c812 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee8b expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.276555:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454c827 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee8b expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045359.276565:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939b81924e00) 00010000:00010000:2.0:1784045359.276567:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045359.276570:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986c00, rc 0) 00000100:00100000:3.0:1784045359.277181:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:10497:x1870706863269120:12345-192.168.203.44@tcp:101:rm.0 Request processed in 1893us (2752us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045359.277193:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 37 00000100:00100000:3.0:1784045359.282273:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045359.283269:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863269376 00000100:00100000:0.0:1784045359.283285:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863269376 00000100:00100000:0.0:1784045359.283695:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:0.0:1784045359.283708:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:10497:x1870706863269376:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1784045359.283785:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784045359.283821:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454c827 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee8b expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.283848:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c7d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee6f expref: 18 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.283862:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939b81924e00) 00010000:00010000:0.0:1784045359.283872:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c7e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee76 expref: 17 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.283924:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b81924900) 00010000:00010000:0.0:1784045359.283929:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045359.283958:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa000/0x5475624df454c82e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.283982:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa000/0x5475624df454c82e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.283994:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa000/0x5475624df454c82e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284006:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c835 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284014:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c835 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284021:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c835 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284157:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c83c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284165:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c83c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284173:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c83c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045359.284514:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1784045359.284527:0:6497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315393081429ns, next at 316393078557ns, rc = 0 00010000:00010000:0.0:1784045359.284595:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c843 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284606:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c843 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284614:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c843 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284621:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c843 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284628:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c843 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284634:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c843 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284674:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784045359.284697:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c83c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284704:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c83c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284710:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c83c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284717:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915ab400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045359.284722:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c83c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284730:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c83c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284749:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939b81924e00) 00010000:00010000:0.0:1784045359.284751:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784045359.284757:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c83c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284763:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c83c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284782:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa000/0x5475624df454c82e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284788:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa000/0x5475624df454c82e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284793:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa000/0x5475624df454c82e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284798:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aa000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045359.284800:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa000/0x5475624df454c82e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284807:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa000/0x5475624df454c82e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284814:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b81924900) 00010000:00010000:0.0:1784045359.284816:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045359.284818:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa000/0x5475624df454c82e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284825:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa000/0x5475624df454c82e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045359.284847:0:6497:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9d1e018 reply state 00000000fce9957c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c835 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284861:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c835 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.284869:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff939b81924600) 00010000:00010000:0.0:1784045359.284871:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784045359.284874:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045359.284991:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:10497:x1870706863269376:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1283us (2729us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784045359.284999:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 38 00010000:00010000:3.0:1784045359.285487:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045359.285496:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c843 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.285504:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915ab200 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045359.285508:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c843 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.285516:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c843 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.285526:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939b81924e00) 00010000:00010000:3.0:1784045359.285529:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784045359.285532:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c843 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.285538:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c843 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045359.285548:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045359.285550:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045359.285552:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045359.291092:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045359.291598:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863269632 00000100:00100000:1.0:1784045359.291612:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863269632 00000100:00100000:1.0:1784045359.291686:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:1.0:1784045359.291699:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:10497:x1870706863269632:12345-192.168.203.44@tcp:35:rm.0 00000100:00100000:1.0:1784045359.292378:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:10497:x1870706863269632:12345-192.168.203.44@tcp:35:rm.0 Request processed in 678us (1296us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1784045359.292387:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:2.0:1784045359.297744:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045359.297869:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863269888 00000100:00100000:0.0:1784045359.297883:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863269888 00000100:00100000:0.0:1784045359.297978:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:0.0:1784045359.297990:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:10497:x1870706863269888:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:0.0:1784045359.298066:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784045359.298103:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454c804 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee84 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.298327:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c7a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee61 expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.298355:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939b81924900) 00010000:00010000:0.0:1784045359.298375:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454c763 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee53 expref: 17 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.298410:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:0.0:1784045359.298421:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045359.298494:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c84a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.298509:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c84a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.298520:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c84a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.298533:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c851 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.298541:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c851 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.298547:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c851 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.298666:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab600/0x5475624df454c858 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.298675:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab600/0x5475624df454c858 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.298683:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab600/0x5475624df454c858 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045359.299669:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1784045359.299695:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab600/0x5475624df454c858 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299719:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab600/0x5475624df454c858 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299726:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab600/0x5475624df454c858 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299733:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915ab600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045359.299738:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab600/0x5475624df454c858 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299746:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab600/0x5475624df454c858 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299759:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff939c813ee400) 00010000:00010000:0.0:1784045359.299762:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784045359.299767:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab600/0x5475624df454c858 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299773:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab600/0x5475624df454c858 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299795:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c84a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299801:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c84a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299807:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c84a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299811:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915ab200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045359.299819:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c84a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299826:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c84a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299835:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c813ee500) 00010000:00010000:0.0:1784045359.299838:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045359.299840:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c84a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299847:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c84a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045359.299861:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000076933c6d reply state 0000000029f9e6d0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c851 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299873:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c851 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045359.299879:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff939c813ee800) 00010000:00010000:0.0:1784045359.299882:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784045359.299885:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045359.300293:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:10497:x1870706863269888:12345-192.168.203.44@tcp:36:rm.0 Request processed in 2299us (2559us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784045359.300303:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 39 00010000:00010000:1.0:1784045360.087306:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784045360.787617:0:8647:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316896169325ns, next at 317896166452ns, rc = 0 00000100:00100000:2.0:1784045360.787710:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873841024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045360.787777:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045360.787841:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045360.787848:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873841152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045360.787870:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045360.787910:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873841024 00000100:00100000:2.0:1784045360.787916:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873841024 00000100:00100000:2.0:1784045360.787974:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873841152 00000100:00100000:2.0:1784045360.787978:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873841152 00000100:00100000:2.0:1784045360.787997:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784045360.788005:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873841024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045360.788027:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045360.788083:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873841024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045360.788090:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784045360.788119:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784045360.788125:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873841152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784045360.788136:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045360.788159:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1375c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873841152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045360.788164:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1784045360.788178:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784045360.788207:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc1374000 x1870706873841152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045360.788225:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873841152:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1784045360.788236:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8c000 x1870706873841024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045360.788247:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873841024:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784045361.111905:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045361.299956:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045361.299978:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873841280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784045361.300052:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045361.300157:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873841280 00000100:00100000:0.0:1784045361.300164:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873841280 00000100:00100000:0.0:1784045361.300214:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784045361.300223:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873841280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045361.300256:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045361.300342:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873841280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045361.300350:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784045361.300505:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873841280:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784045362.133767:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045362.368182:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045362.368240:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045362.368273:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045362.368322:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863270272 00000100:00100000:3.0:1784045362.368334:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863270272 00000100:00100000:3.0:1784045362.368413:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863270144 00000100:00100000:3.0:1784045362.368417:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863270144 00000100:00100000:0.0:1784045362.368964:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863270016 00000100:00100000:0.0:1784045362.368971:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863270016 00000100:00100000:0.0:1784045362.369016:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 337 00000100:00100000:0.0:1784045362.369028:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863270016:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045362.369122:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863270016:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 96us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045362.369130:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 337 00000100:00100000:3.0:1784045362.370170:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 220 00000100:00100000:3.0:1784045362.370189:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863270272:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045362.373074:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863270272:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 2876us (4817us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045362.373093:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 220 00000100:00100000:3.0:1784045362.373141:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 221 00000100:00100000:3.0:1784045362.373162:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:2395:x1870706863270144:12345-192.168.203.44@tcp:400:kworker.0 00000100:00080000:2.0:1784045362.374576:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045362.375479:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045362.376256:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045362.376435:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045362.376486:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045362.376523:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863270656 00000100:00100000:0.0:1784045362.376535:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863270656 00000100:00100000:1.0:1784045362.378835:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863270400 00000100:00100000:1.0:1784045362.378857:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863270400 00000100:00100000:3.0:1784045362.378942:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:2395:x1870706863270144:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 5781us (10657us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045362.378945:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 107 00000100:00100000:1.0:1784045362.378958:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863270400:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045362.378962:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 221 00000100:00100000:3.0:1784045362.378992:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863270528 00000100:00100000:3.0:1784045362.378997:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863270528 00000100:00100000:3.0:1784045362.379024:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 222 00000100:00100000:3.0:1784045362.379031:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863270528:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045362.379052:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863270400:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 95us (2803us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045362.379060:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 107 00000100:00100000:3.0:1784045362.379071:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863270528:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 39us (2583us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045362.379080:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 222 00000100:00080000:1.0:1784045362.379107:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045362.379114:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045362.379142:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045362.379185:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 223 00000100:00100000:0.0:1784045362.379195:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863270656:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045362.379226:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863270656:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 33us (2792us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045362.379231:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 223 00000100:00100000:0.0:1784045362.835847:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873841536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045362.835922:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873841664:0@lo:400:kworker.0 00000100:00100000:0.0:1784045362.835945:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045362.835958:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.836124:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873841408:0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.836177:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.836203:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873841920:0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.836226:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.836244:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873842432:0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.836269:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.836287:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873842944:0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.836335:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.836357:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784045362.836364:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873841792:0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.836384:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.836398:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873842304:0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.836399:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873842176:0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.836423:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.836464:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873842816:0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.836467:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873841664 00000100:00100000:3.0:1784045362.836482:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873841664 00000100:00100000:2.0:1784045362.836486:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.836513:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873841536 00000100:00100000:2.0:1784045362.836517:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873841536 00000100:00100000:3.0:1784045362.836531:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873841920 00000100:00100000:3.0:1784045362.836534:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873841920 00000100:00100000:2.0:1784045362.836541:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873841792 00000100:00100000:2.0:1784045362.836543:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873841792 00000100:00100000:3.0:1784045362.836545:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873842304 00000100:00100000:3.0:1784045362.836547:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873842304 00000100:00100000:2.0:1784045362.836558:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784045362.836567:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3623:x1870706873841536:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045362.836569:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873842816 00000100:00100000:3.0:1784045362.836571:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873842816 00000100:00100000:3.0:1784045362.836584:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784045362.836589:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873841664:12345-0@lo:400:kworker.0 00000004:00000024:2.0:1784045362.836625:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784045362.836648:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873841664:12345-0@lo:400:kworker.0 Request processed in 59us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045362.836656:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1784045362.836659:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3623:x1870706873841536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045362.836674:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784045362.836674:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784045362.836679:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873841920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.836687:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1784045362.836692:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873841792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.836712:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873841920:12345-0@lo:400:kworker.0 Request processed in 33us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045362.836716:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873841792:12345-0@lo:400:kworker.0 Request processed in 23us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045362.836718:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784045362.836721:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784045362.836728:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1784045362.836739:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873842432 00000100:00100000:2.0:1784045362.836742:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873842432 00000100:00100000:2.0:1784045362.836769:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873842944 00000100:00100000:2.0:1784045362.836772:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873842944 00000100:00100000:2.0:1784045362.836801:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784045362.836807:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873842432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.836842:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873842432:12345-0@lo:400:kworker.0 Request processed in 35us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045362.836848:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784045362.836859:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784045362.836865:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873842944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.836872:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873842304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.836892:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1375500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873842944:12345-0@lo:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045362.836897:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784045362.836939:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.836954:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873842688:0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.836964:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873842304:12345-0@lo:400:kworker.0 Request processed in 231us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045362.836971:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1784045362.836974:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.837008:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873841664:0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.837024:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784045362.837030:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873842048:0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.837046:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873842176 00000100:00100000:3.0:1784045362.837050:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873842176 00000100:00100000:3.0:1784045362.837069:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873842688 00000100:00100000:3.0:1784045362.837072:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873842688 00000100:00100000:3.0:1784045362.837085:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1784045362.837090:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873842816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.837129:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873842816:12345-0@lo:400:kworker.0 Request processed in 39us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045362.837135:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1784045362.837147:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784045362.837152:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873842176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045362.837155:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873841408 00000100:00100000:1.0:1784045362.837159:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873841408 00000100:00100000:3.0:1784045362.837176:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873842176:12345-0@lo:400:kworker.0 Request processed in 25us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045362.837182:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1784045362.837191:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1784045362.837192:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1784045362.837197:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873842688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045362.837197:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873841408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.837221:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873842688:12345-0@lo:400:kworker.0 Request processed in 24us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045362.837227:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1784045362.837227:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873841408:12345-0@lo:400:kworker.0 Request processed in 30us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045362.837233:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1784045362.837253:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873841792:0@lo:400:kworker.0 00010000:00080000:3.0:1784045362.837267:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8d180 x1870706873842304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784045362.837272:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045362.837277:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045362.837279:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873842304:0@lo:400:kworker.0 00000100:00080000:1.0:1784045362.837279:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045362.837281:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784045362.837288:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82880380 x1870706873842816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045362.837296:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873842816:0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.837304:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873841408:0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.837313:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873841920:0@lo:400:kworker.0 00010000:00080000:3.0:1784045362.837334:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8c000 x1870706873842432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045362.837342:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873842432:0@lo:400:kworker.0 00010000:00080000:3.0:1784045362.837351:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82881f80 x1870706873842944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045362.837359:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873842944:0@lo:400:kworker.0 00000100:00100000:0.0:1784045362.837485:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873841536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045362.838503:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.838546:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873842560:0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.838571:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.838599:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873843072:0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.838644:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045362.838696:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873842176:0@lo:400:kworker.0 00000100:00100000:2.0:1784045362.838710:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873842688:0@lo:400:kworker.0 00000100:00100000:1.0:1784045362.838928:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873842560 00000100:00100000:1.0:1784045362.838936:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873842560 00000100:00100000:3.0:1784045362.838962:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873843072 00000100:00100000:3.0:1784045362.838967:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873843072 00000100:00080000:2.0:1784045362.839061:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045362.839209:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873842048 00000100:00100000:0.0:1784045362.839214:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873842048 00000100:00100000:0.0:1784045362.839261:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784045362.839281:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873842048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045362.839363:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873842048:12345-0@lo:400:kworker.0 Request processed in 85us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045362.839370:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784045362.839415:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873842048:0@lo:400:kworker.0 00000100:00100000:1.0:1784045362.839696:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784045362.839706:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873842560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045362.839761:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873842560:12345-0@lo:400:kworker.0 Request processed in 57us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045362.839768:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1784045362.839987:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82882a00 x1870706873842560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045362.839999:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873842560:0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.841554:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784045362.841571:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873843072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045362.841726:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873843072:12345-0@lo:400:kworker.0 Request processed in 159us (3088us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045362.841734:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1784045362.841821:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82880e00 x1870706873843072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045362.841839:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873843072:0@lo:400:kworker.0 00000100:00080000:2.0:1784045362.846522:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784045363.165758:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045363.348338:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873843200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045363.348438:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045363.348624:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873843200 00000100:00100000:2.0:1784045363.348635:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873843200 00000100:00100000:2.0:1784045363.348701:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784045363.348712:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873843200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045363.348759:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045363.348814:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873843200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045363.348822:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:0.0:1784045363.349204:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6926a00 x1870706873843200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045363.349227:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873843200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045363.354375:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045363.354412:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873843328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045363.354534:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045363.354663:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873843328 00000100:00100000:3.0:1784045363.354673:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873843328 00000100:00100000:3.0:1784045363.354746:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784045363.354758:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8364b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873843328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784045363.354793:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045363.354856:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8364b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873843328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045363.354865:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1784045363.354917:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82881f80 x1870706873843328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045363.354939:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873843328:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1784045364.179887:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784045364.247262:0:13660:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:3.0:1784045364.887180:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1784045364.887262:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1784045364.887273:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1784045364.889031:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045364.889052:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873843456:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784045364.889118:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045364.889183:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873843456 00000100:00100000:0.0:1784045364.889202:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873843456 00000100:00100000:0.0:1784045364.889256:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784045364.889266:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873843456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784045364.889290:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1784045364.889323:0:8413:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a565f2e, atime: 0x6a565f2e, ctime: 0x6a565f2e, blocks: 0x0 00010000:00010000:0.0:1784045364.889331:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030412295/0x5475624df454c85f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045364.889348:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1784045364.889352:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045364.889359:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030412295/0x5475624df454c85f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045364.889375:0:8413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030412295/0x5475624df454c85f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045364.889386:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030412295/0x5475624df454c85f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.889994:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454c7b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.890007:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454c7b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.890015:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454c7b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.890020:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cd000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045364.890025:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454c7b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.890032:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454c7b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.890047:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff939b81924600) 00010000:00010000:3.0:1784045364.890049:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045364.890053:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454c7b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045364.891702:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030412295/0x5475624df454c85f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045364.891749:0:8413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045364.892035:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454c7b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892065:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c7cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892072:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c7cc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892091:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c7cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892096:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045364.892101:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c7cc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892109:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c7cc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892125:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff939b81924e00) 00010000:00010000:3.0:1784045364.892128:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045364.892132:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c7cc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892138:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454c7cc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892157:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c835 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892164:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c835 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892170:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c835 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892176:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aaa00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045364.892179:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c835 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892197:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c835 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892207:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff939b81924600) 00010000:00010000:3.0:1784045364.892210:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045364.892213:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c835 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892218:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c835 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892236:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c851 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892242:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c851 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892248:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c851 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892253:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915abe00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045364.892256:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c851 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892262:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c851 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892269:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff939c813ee800) 00010000:00010000:3.0:1784045364.892271:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045364.892275:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c851 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045364.892287:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c851 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045364.892714:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1870706873843456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3445us (3591us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1784045364.892726:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1784045364.892760:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784045364.892788:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045364.892795:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030412295/0x5475624df454c85f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045364.892806:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aa000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:0.0:1784045364.892810:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030412295/0x5475624df454c85f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045364.892819:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030412295/0x5475624df454c85f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045364.892836:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030412295/0x5475624df454c85f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045364.892843:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030412295/0x5475624df454c85f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045364.892875:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045364.892878:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045364.892880:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784045364.893063:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939cbf4d6d80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1784045364.893070:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873843456:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1784045365.203654:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784045365.256105:0:13708:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0fdeda70 20000000:00000080:2.0:1784045365.256123:0:13708:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939b8233e800 uarg=0000000000000000 20000000:01000000:2.0:1784045365.256164:0:13708:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1784045365.256171:0:13708:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1784045365.256176:0:13708:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1784045365.257032:0:13709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1784045365.257196:0:13708:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1784045365.266812:0:13708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1784045365.266852:0:13708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1784045365.266882:0:13708:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1784045365.266900:0:13708:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784045365.266919:0:13708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.266937:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc2171000/0x5475624df454c6ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee3e expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.266946:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c915abc00/0x5475624df454c6f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee45 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.266954:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc2171600/0x5475624df454c701 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c6fa expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.266976:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b836cc200/0x5475624df454c70f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c708 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.266984:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc2171800/0x5475624df454c71d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c716 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.266991:0:13708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939cc2170200/0x5475624df454c72b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c724 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.267000:0:13708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.267038:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc2170200/0x5475624df454c72b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c724 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.267053:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc2170200/0x5475624df454c72b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c724 expref: 23 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045365.267068:0:13708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6924e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1870706873843584:0@lo:104: 00000100:00100000:2.0:1784045365.267135:0:13708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045365.267202:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc2171800/0x5475624df454c71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c716 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.267211:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc2171800/0x5475624df454c71d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c716 expref: 23 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045365.267221:0:13708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6924700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1870706873843712:0@lo:104: 00010000:00010000:2.0:1784045365.267246:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b836cc200/0x5475624df454c70f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c708 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.267264:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939b836cc200/0x5475624df454c70f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c708 expref: 23 pid: 6489 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045365.267273:0:13708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1870706873843840:0@lo:104: 00010000:00010000:2.0:1784045365.267302:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc2171600/0x5475624df454c701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454c6fa expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.267310:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff939cc2171600/0x5475624df454c701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454c6fa expref: 23 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045365.267317:0:13708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6926a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1870706873843968:0@lo:104: 00010000:00010000:2.0:1784045365.267342:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c915abc00/0x5475624df454c6f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee45 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.267351:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939c915abc00/0x5475624df454c6f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee45 expref: 12 pid: 6488 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045365.267360:0:13708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1870706873844096:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045365.267410:0:13708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939cc2171000/0x5475624df454c6ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee3e expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045365.267418:0:13708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939cc2171000/0x5475624df454c6ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee3e expref: 12 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045365.267427:0:13708:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1870706873844224:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045365.267492:0:13708:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b8222fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1784045365.268540:0:6479:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784045365.268571:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045365.268613:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045365.268625:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045365.268635:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873843584 00000100:00100000:1.0:1784045365.268641:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873843584 00000100:00100000:1.0:1784045365.268677:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873843712 00000100:00100000:1.0:1784045365.268680:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873843712 00000100:00100000:1.0:1784045365.268688:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873843840 00000100:00100000:1.0:1784045365.268690:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873843840 00000100:00100000:1.0:1784045365.268698:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873843968 00000100:00100000:1.0:1784045365.268700:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873843968 00000100:00100000:1.0:1784045365.268712:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784045365.268720:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+6:13708:x1870706873843584:12345-0@lo:104: 00010000:00010000:1.0:1784045365.268736:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c72b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.268809:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045365.268815:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830e4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+6:13708:x1870706873843584:12345-0@lo:104: Request processed in 96us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045365.268822:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784045365.268864:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784045365.268870:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:13708:x1870706873843712:12345-0@lo:104: 00010000:00010000:1.0:1784045365.268887:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c71d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.268920:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784045365.268925:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+5:13708:x1870706873843712:12345-0@lo:104: Request processed in 56us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045365.268931:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784045365.268945:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784045365.268951:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:13708:x1870706873843840:12345-0@lo:104: 00010000:00010000:1.0:1784045365.268959:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c70f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.268987:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784045365.268993:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+4:13708:x1870706873843840:12345-0@lo:104: Request processed in 43us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045365.268998:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784045365.269011:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784045365.269017:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:13708:x1870706873843968:12345-0@lo:104: 00010000:00010000:1.0:1784045365.269023:0:6479:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c701 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269053:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1784045365.269058:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+3:13708:x1870706873843968:12345-0@lo:104: Request processed in 42us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045365.269063:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1784045365.269080:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784045365.269086:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c72b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269100:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cd800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045365.269105:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c72b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269113:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c72b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045365.269120:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c72b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045365.269126:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784045365.269158:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c72b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269165:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045365.269185:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c72b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269191:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454c724 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c72b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269203:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784045365.269206:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c71d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269212:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2170000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045365.269215:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c71d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269231:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c71d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045365.269237:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c71d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045365.269243:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784045365.269257:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c71d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269263:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045365.269269:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c71d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269275:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc2170000/0x5475624df454c716 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c71d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269285:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045365.269287:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c70f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269293:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045365.269295:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c70f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269301:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c70f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045365.269307:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c70f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045365.269320:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784045365.269334:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c70f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269339:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045365.269356:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c70f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269362:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc2171200/0x5475624df454c708 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c70f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269371:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045365.269374:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454c701 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269379:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045365.269382:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454c701 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269389:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454c701 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045365.269395:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454c701 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045365.269400:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784045365.269412:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c701 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269417:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045365.269437:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c701 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269467:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81987200/0x5475624df454c6fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454c701 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269484:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045365.269486:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045365.269488:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045365.269495:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045365.269500:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045365.269512:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873844352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045365.269549:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045365.269577:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045365.269583:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873844480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045365.269615:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045365.269641:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873844608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045365.269662:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045365.269679:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045365.269685:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873844736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045365.269709:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045365.269735:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873844352 00000100:00100000:1.0:1784045365.269740:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873844352 00010000:00010000:1.0:1784045365.269761:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc2170200/0x5475624df454c72b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c724 expref: 24 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045365.269776:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873844480 00000100:00100000:1.0:1784045365.269779:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873844480 00010000:00010000:1.0:1784045365.269789:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc2171800/0x5475624df454c71d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c716 expref: 25 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045365.269808:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873844608 00000100:00100000:1.0:1784045365.269810:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873844608 00010000:00010000:1.0:1784045365.269822:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b836cc200/0x5475624df454c70f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c708 expref: 26 pid: 6489 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045365.269832:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873844736 00000100:00100000:1.0:1784045365.269834:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873844736 00010000:00010000:1.0:1784045365.269842:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc2171600/0x5475624df454c701 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c6fa expref: 27 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045365.269854:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784045365.269860:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+27:3623:x1870706873844352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045365.269870:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045365.269875:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc2170200/0x5475624df454c72b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c724 expref: 27 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045365.269883:0:13708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6924e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1870706873843584:0@lo:104: 00010000:00010000:1.0:1784045365.269885:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc2170200/0x5475624df454c72b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c724 expref: 27 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045365.269892:0:13708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6924700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1870706873843712:0@lo:104: 00010000:00010000:1.0:1784045365.269899:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc2170200/0x5475624df454c72b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c724 expref: 27 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045365.269899:0:13708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1870706873843840:0@lo:104: 00000100:00100000:0.0:1784045365.269907:0:13708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6926a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1870706873843968:0@lo:104: 00010000:00010000:1.0:1784045365.269911:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045365.269937:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+26:3623:x1870706873844352:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045365.269943:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784045365.269959:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784045365.269961:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873844352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045365.269965:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+25:3623:x1870706873844480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045365.269980:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045365.269984:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc2171800/0x5475624df454c71d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c716 expref: 25 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.269992:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc2171800/0x5475624df454c71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c716 expref: 25 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.270002:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc2171800/0x5475624df454c71d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c716 expref: 25 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.270010:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045365.270045:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873844480:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045365.270051:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784045365.270068:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784045365.270074:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:3625:x1870706873844608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045365.270081:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045365.270085:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b836cc200/0x5475624df454c70f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c708 expref: 23 pid: 6489 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.270093:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b836cc200/0x5475624df454c70f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c708 expref: 23 pid: 6489 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.270102:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b836cc200/0x5475624df454c70f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c708 expref: 23 pid: 6489 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.270110:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045365.270135:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:3625:x1870706873844608:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045365.270150:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784045365.270164:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784045365.270170:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:3625:x1870706873844736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045365.270179:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045365.270183:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc2171600/0x5475624df454c701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454c6fa expref: 21 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.270193:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc2171600/0x5475624df454c701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454c6fa expref: 21 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.270202:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc2171600/0x5475624df454c701 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454c6fa expref: 21 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.270210:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045365.270232:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:3625:x1870706873844736:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045365.270238:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784045365.270271:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873844736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045365.270278:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873844608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045365.271159:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873844480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045365.274396:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045365.274578:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863270784 00000100:00100000:3.0:1784045365.274586:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863270784 00010000:00010000:3.0:1784045365.274635:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939cc2171000/0x5475624df454c6ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee3e expref: 13 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045365.274671:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:3.0:1784045365.274680:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863270784:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045365.274693:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045365.274698:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939cc2171000/0x5475624df454c6ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee3e expref: 13 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045365.274709:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939cc2171000/0x5475624df454c6ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee3e expref: 13 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045365.274730:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045365.274777:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863270784:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 98us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045365.274784:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:1.0:1784045365.276049:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045365.276087:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863270912 00000100:00100000:1.0:1784045365.276105:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863270912 00010000:00010000:1.0:1784045365.276136:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c915abc00/0x5475624df454c6f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee45 expref: 13 pid: 6488 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045365.276179:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:1.0:1784045365.276213:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6926d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863270912:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045365.276226:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045365.276233:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c915abc00/0x5475624df454c6f3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee45 expref: 13 pid: 6488 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.276245:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c915abc00/0x5475624df454c6f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee45 expref: 13 pid: 6488 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.276264:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.276273:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.276290:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.276298:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.276305:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.276312:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.276319:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986800 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045365.276333:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.276341:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.276357:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045365.276368:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045365.276416:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6926d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863270912:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 205us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045365.276434:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 51 00010000:00010000:0.0:1784045365.277146:0:13708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc2171000/0x5475624df454c6ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee3e expref: 12 pid: 6490 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045365.277166:0:13708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1870706873844224:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045365.277182:0:13708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915abc00/0x5475624df454c6f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ee45 expref: 11 pid: 6488 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045365.277192:0:13708:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13708:1870706873844096:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045365.277231:0:13708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045365.277242:0:13708:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045365.277248:0:13708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045365.277254:0:13708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81986800/0x5475624df454c866 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045365.909643:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873844864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784045365.909712:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045365.909822:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873844864 00000100:00100000:0.0:1784045365.909830:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873844864 00000100:00100000:0.0:1784045365.909901:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784045365.909911:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873844864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784045365.909940:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045365.909986:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6926a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873844864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045365.909993:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1784045365.910111:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045365.910148:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873844864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045365.910592:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873844992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045365.910638:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045365.910739:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873844992 00000100:00100000:2.0:1784045365.910751:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873844992 00000100:00100000:2.0:1784045365.910788:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784045365.910796:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873844992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045365.910809:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045365.917378:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873844992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6573us (6728us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045365.917392:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784045365.918012:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873844992:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1784045366.101584:0:13757:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce77e9530 20000000:00000080:0.0:1784045366.101610:0:13757:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939cb695f800 uarg=0000000000000000 20000000:01000000:0.0:1784045366.101654:0:13757:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1784045366.101659:0:13757:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1784045366.101664:0:13757:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1784045366.102587:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1784045366.102692:0:13757:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1784045366.102781:0:13757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1784045366.102813:0:13757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1784045366.102833:0:13757:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1784045366.102845:0:13757:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784045366.102865:0:13757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939b81986c00/0x5475624df454c86d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.102890:0:13757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986c00/0x5475624df454c86d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.102899:0:13757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b81986c00/0x5475624df454c86d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.102906:0:13757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b81986c00/0x5475624df454c86d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.102913:0:13757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939b81986c00/0x5475624df454c86d lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.102919:0:13757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939b81986c00/0x5475624df454c86d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.102925:0:13757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986c00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045366.102936:0:13757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939b81986c00/0x5475624df454c86d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.102944:0:13757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939b81986c00/0x5475624df454c86d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.102955:0:13757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939b81986c00/0x5475624df454c86d lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.102963:0:13757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939b81986c00/0x5475624df454c86d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.102969:0:13757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81986c00/0x5475624df454c86d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045366.231347:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045366.401389:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045366.402096:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863271040 00000100:00100000:1.0:1784045366.402107:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863271040 00000100:00100000:1.0:1784045366.402239:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 339 00000100:00100000:1.0:1784045366.402251:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:6167:x1870706863271040:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045366.402269:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045366.402413:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b836cc600/0x5475624df454c874 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73ee92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045366.402466:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836cc600/0x5475624df454c874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee92 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045366.402480:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b836cc600/0x5475624df454c874 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee92 expref: 12 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045366.402490:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cc600, rc 0) 00000100:00100000:1.0:1784045366.402570:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:6167:x1870706863271040:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 321us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045366.402578:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 339 00000100:00100000:3.0:1784045366.404687:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045366.404754:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863271168 00000100:00100000:1.0:1784045366.404762:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863271168 00000100:00100000:1.0:1784045366.405098:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 340 00000100:00100000:1.0:1784045366.405109:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:6167:x1870706863271168:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045366.405262:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:6167:x1870706863271168:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 155us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045366.405271:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 340 00000100:00100000:3.0:1784045366.407020:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045366.407151:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863271296 00000100:00100000:1.0:1784045366.407355:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863271296 00000100:00100000:1.0:1784045366.407416:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 341 00000100:00100000:1.0:1784045366.407425:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:6167:x1870706863271296:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045366.408333:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:6167:x1870706863271296:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 906us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045366.408386:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 341 00000100:00100000:3.0:1784045366.411686:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045366.412179:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863271424 00000100:00100000:1.0:1784045366.412188:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863271424 00000100:00100000:1.0:1784045366.412239:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 342 00000100:00100000:1.0:1784045366.412248:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:10781:x1870706863271424:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784045366.412591:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:10781:x1870706863271424:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 343us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045366.412607:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 342 00000100:00100000:3.0:1784045366.420324:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045366.420696:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863271552 00000100:00100000:1.0:1784045366.420716:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863271552 00000100:00100000:1.0:1784045366.420775:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 343 00000100:00100000:1.0:1784045366.420786:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:10781:x1870706863271552:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784045366.420932:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:10781:x1870706863271552:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 147us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045366.420941:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 343 00000100:00100000:2.0:1784045366.422261:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873845120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045366.422321:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045366.424227:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873845120 00000100:00100000:3.0:1784045366.424241:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873845120 00000100:00100000:3.0:1784045366.424306:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1784045366.424316:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873845120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045366.427084:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045366.427202:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873845120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2884us (4876us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045366.427213:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1784045366.427581:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873845120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784045366.428417:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045366.430059:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863271680 00000100:00100000:1.0:1784045366.430072:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863271680 00000100:00100000:1.0:1784045366.430141:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 344 00000100:00100000:1.0:1784045366.430152:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:6167:x1870706863271680:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045366.430170:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045366.430188:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b836cd200/0x5475624df454c87b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73ee99 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045366.430216:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836cd200/0x5475624df454c87b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee99 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045366.430228:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b836cd200/0x5475624df454c87b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee99 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045366.430237:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cd200, rc 0) 00000100:00100000:1.0:1784045366.430305:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:6167:x1870706863271680:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 156us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045366.430313:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 344 00000100:00100000:3.0:1784045366.437401:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045366.438097:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863271808 00000100:00100000:1.0:1784045366.438109:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863271808 00000100:00100000:1.0:1784045366.438182:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 345 00000100:00100000:1.0:1784045366.438193:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:6167:x1870706863271808:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045366.438357:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:6167:x1870706863271808:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 165us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045366.438365:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 345 00000100:00100000:2.0:1784045366.446828:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045366.446890:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863271936 00000100:00100000:3.0:1784045366.447011:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863271936 00000100:00100000:3.0:1784045366.447074:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 346 00000100:00100000:3.0:1784045366.447085:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:6167:x1870706863271936:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045366.447243:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:6167:x1870706863271936:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 159us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045366.447252:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 346 00000100:00100000:3.0:1784045366.455046:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045366.455301:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863272064 00000100:00100000:0.0:1784045366.455312:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863272064 00000100:00100000:0.0:1784045366.455522:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 347 00000100:00100000:0.0:1784045366.455533:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:10785:x1870706863272064:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784045366.455715:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:10785:x1870706863272064:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 183us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045366.455723:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 347 00000100:00100000:0.0:1784045366.465376:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045366.465900:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863272192 00000100:00100000:3.0:1784045366.465910:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863272192 00000100:00100000:3.0:1784045366.465961:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 348 00000100:00100000:3.0:1784045366.465987:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:10785:x1870706863272192:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784045366.466150:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:10785:x1870706863272192:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 179us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045366.466159:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 348 10000000:01000000:0.0:1784045366.675625:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784045366.675633:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939b82301000 from 7 10000000:01000000:0.0:1784045366.675638:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784045366.675697:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045366.675709:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045366.675720:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045366.675776:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873845248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784045366.675843:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045366.675928:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045366.676085:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873845248 00000100:00100000:1.0:1784045366.676093:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873845248 00000100:00100000:1.0:1784045366.676150:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784045366.676159:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:6493:x1870706873845248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045366.676172:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045366.676187:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b836ccc00/0x5475624df454c889 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c882 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045366.676209:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836ccc00/0x5475624df454c889 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c882 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045366.676220:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b836ccc00/0x5475624df454c889 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c882 expref: 21 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045366.676229:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836ccc00, rc 0) 00000100:00100000:1.0:1784045366.676280:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873845248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045366.676287:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1784045366.676534:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873845248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045366.676550:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045366.676558:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045366.676630:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873845376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045366.676668:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045366.676698:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045366.676783:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873845376 00000100:00100000:1.0:1784045366.676788:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873845376 00000100:00100000:1.0:1784045366.676822:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784045366.676830:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873845376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045366.676942:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873845376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045366.676961:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1784045366.677082:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873845376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045366.677108:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873845504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045366.677151:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045366.677172:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b180 going to sleep for 11 seconds 00000100:00100000:3.0:1784045366.677272:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873845504 00000100:00100000:3.0:1784045366.677277:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873845504 00000100:00100000:3.0:1784045366.677310:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1784045366.677316:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873845504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045366.677400:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873845504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045366.677407:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1784045366.677525:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873845504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045366.677964:0:13770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13770:1870706873845632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045366.678008:0:13770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045366.678133:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873845632 00000100:00100000:2.0:1784045366.678138:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873845632 00000100:00100000:2.0:1784045366.678176:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1784045366.678184:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:13770:x1870706873845632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045366.678273:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:13770:x1870706873845632:12345-0@lo:502:llog_process_th.0 Request processed in 90us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045366.678280:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1784045366.678329:0:13770:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045366.678345:0:13770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13770:1870706873845632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784045366.678366:0:13770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045366.678379:0:13770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045366.678381:0:13770:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784045366.678389:0:13770:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939b82301000 00000020:00000080:0.0:1784045366.678392:0:13770:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784045366.678500:0:13770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045366.678544:0:13770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045366.678546:0:13770:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784045366.678550:0:13770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045366.678553:0:13770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045366.678554:0:13770:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784045366.678558:0:13770:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939b82301000 00000020:00000080:0.0:1784045366.678560:0:13770:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784045366.678607:0:13770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13770:1870706873845760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045366.678643:0:13770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045366.681239:0:13770:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045366.681473:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873845760 00000100:00100000:3.0:1784045366.681482:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873845760 00000100:00100000:3.0:1784045366.681533:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1784045366.681543:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:13770:x1870706873845760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045366.682209:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:13770:x1870706873845760:12345-0@lo:502:llog_process_th.0 Request processed in 665us (3563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045366.682217:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1784045366.682527:0:13770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13770:1870706873845760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784045366.682560:0:13770:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045366.682569:0:13770:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045366.682571:0:13770:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784045366.682577:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784045366.683126:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1784045366.683148:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045366.683158:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045366.683168:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045366.683178:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784045366.683181:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939cc10ba000 from 7 10000000:01000000:3.0:1784045366.683184:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045366.683219:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045366.683228:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045366.683243:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045366.683264:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873845888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045366.683309:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045366.683337:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1784045366.683569:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873845888 00000100:00100000:0.0:1784045366.683576:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873845888 00000100:00100000:0.0:1784045366.683624:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1784045366.683633:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:6493:x1870706873845888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045366.683645:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045366.683730:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c915ab600/0x5475624df454c897 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c890 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045366.683755:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c915ab600/0x5475624df454c897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c890 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045366.683777:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c915ab600/0x5475624df454c897 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c890 expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045366.683785:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915ab600, rc 0) 00000100:00100000:0.0:1784045366.686920:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873845888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3279us (3602us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045366.686934:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1784045366.696131:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873845888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045366.696161:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.696182:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045366.696395:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873846016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045366.696546:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045366.696584:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c91584f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045366.697154:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873846016 00000100:00100000:3.0:1784045366.697161:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873846016 00000100:00100000:3.0:1784045366.697218:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1784045366.697228:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873846016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045366.697373:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873846016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045366.697381:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1784045366.702406:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873846016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045366.702496:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873846144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045366.702570:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045366.702621:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045366.702742:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873846144 00000100:00100000:2.0:1784045366.702749:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873846144 00000100:00100000:2.0:1784045366.702787:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1784045366.702795:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873846144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045366.702905:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873846144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045366.702912:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1784045366.703401:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873846144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045366.703853:0:13773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13773:1870706873846272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045366.703904:0:13773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045366.703940:0:13773:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c91584b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045366.703997:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873846272 00000100:00100000:3.0:1784045366.704002:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873846272 00000100:00100000:3.0:1784045366.704041:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1784045366.704049:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:13773:x1870706873846272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045366.704162:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:13773:x1870706873846272:12345-0@lo:502:llog_process_th.0 Request processed in 114us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045366.704170:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1784045366.704251:0:13773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13773:1870706873846272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784045366.704278:0:13773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045366.704287:0:13773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045366.704290:0:13773:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784045366.704307:0:13773:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939cc10ba000 00000020:00000080:0.0:1784045366.704311:0:13773:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784045366.704370:0:13773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045366.704374:0:13773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045366.704375:0:13773:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784045366.704378:0:13773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045366.704381:0:13773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045366.704382:0:13773:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784045366.704385:0:13773:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939cc10ba000 00000020:00000080:0.0:1784045366.704387:0:13773:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784045366.704429:0:13773:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13773:1870706873846400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045366.704509:0:13773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045366.704527:0:13773:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b180 going to sleep for 11 seconds 00000100:00100000:3.0:1784045366.705040:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873846400 00000100:00100000:3.0:1784045366.705046:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873846400 00000100:00100000:3.0:1784045366.705084:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1784045366.705092:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:13773:x1870706873846400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045366.705191:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:13773:x1870706873846400:12345-0@lo:502:llog_process_th.0 Request processed in 99us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045366.705205:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1784045366.705253:0:13773:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13773:1870706873846400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784045366.705276:0:13773:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045366.705282:0:13773:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045366.705283:0:13773:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1784045366.705287:0:13773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1784045366.705870:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1784045366.705895:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784045366.705904:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045366.705916:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045366.705926:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784045366.705929:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939c9157c000 from 7 10000000:01000000:0.0:1784045366.705932:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784045366.705956:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045366.705963:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045366.705971:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045366.705990:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873846528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784045366.706029:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045366.706066:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a9b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045366.706130:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873846528 00000100:00100000:2.0:1784045366.706135:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873846528 00000100:00100000:2.0:1784045366.706174:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1784045366.706181:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:6493:x1870706873846528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045366.706191:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045366.706204:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81987c00/0x5475624df454c8a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c89e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.706227:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987c00/0x5475624df454c8a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c89e expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.706248:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81987c00/0x5475624df454c8a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c89e expref: 23 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.706257:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987c00, rc 0) 00000100:00100000:2.0:1784045366.706296:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873846528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045366.706308:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1784045366.706345:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873846528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045366.706358:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.706367:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045366.706419:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873846656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045366.706475:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045366.706487:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c937ea480 going to sleep for 11 seconds 00000100:00100000:2.0:1784045366.706498:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873846656 00000100:00100000:2.0:1784045366.706501:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873846656 00000100:00100000:2.0:1784045366.706517:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1784045366.706523:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873846656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045366.706635:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873846656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045366.706642:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1784045366.708499:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873846656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045366.708587:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873846784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045366.709501:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045366.709550:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c937ea480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045366.709631:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873846784 00000100:00100000:1.0:1784045366.709639:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873846784 00000100:00100000:1.0:1784045366.709706:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1784045366.709716:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873846784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045366.709862:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873846784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045366.709870:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1784045366.710125:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873846784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784045366.714211:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784045366.715080:0:13775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13775:1870706873846912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045366.715161:0:13775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045366.715214:0:13775:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c937ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1784045366.715270:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873846912 00000100:00100000:3.0:1784045366.715277:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873846912 00000100:00100000:3.0:1784045366.715326:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1784045366.715337:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:13775:x1870706873846912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045366.715486:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:13775:x1870706873846912:12345-0@lo:502:llog_process_th.0 Request processed in 151us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045366.715494:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1784045366.716144:0:13775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13775:1870706873846912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045366.716176:0:13775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045366.716186:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045366.716189:0:13775:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784045366.716196:0:13775:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939c9157c000 00000020:00000080:2.0:1784045366.716199:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784045366.716274:0:13775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045366.716279:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045366.716280:0:13775:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784045366.716284:0:13775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045366.716287:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045366.716289:0:13775:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784045366.716292:0:13775:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939c9157c000 00000020:00000080:2.0:1784045366.716294:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784045366.716873:0:13775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13775:1870706873847040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045366.716931:0:13775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045366.716970:0:13775:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c937ea540 going to sleep for 11 seconds 00000100:00100000:3.0:1784045366.717930:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873847040 00000100:00100000:3.0:1784045366.717938:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873847040 00000100:00100000:3.0:1784045366.720504:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1784045366.720528:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:13775:x1870706873847040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045366.720732:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:13775:x1870706873847040:12345-0@lo:502:llog_process_th.0 Request processed in 216us (3799us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045366.720741:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1784045366.720894:0:13775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13775:1870706873847040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045366.720931:0:13775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045366.720946:0:13775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045366.720948:0:13775:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784045366.720953:0:13775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784045366.721124:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1784045366.721165:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045366.721176:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045366.721186:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045366.721204:0:6493:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784045366.721207:0:6493:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939c9775c000 from 7 10000000:01000000:3.0:1784045366.721210:0:6493:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045366.721239:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045366.721248:0:6493:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045366.721258:0:6493:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045366.721280:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873847168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045366.721318:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045366.721349:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d1780 going to sleep for 11 seconds 00000100:00100000:2.0:1784045366.721397:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873847168 00000100:00100000:2.0:1784045366.721404:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873847168 00000100:00100000:2.0:1784045366.721479:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1784045366.721488:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:6493:x1870706873847168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045366.721498:0:6490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045366.721510:0:6490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81986400/0x5475624df454c8b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454c8ac expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.721533:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986400/0x5475624df454c8b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454c8ac expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.721544:0:6490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81986400/0x5475624df454c8b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454c8ac expref: 24 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.721554:0:6490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986400, rc 0) 00000100:00100000:2.0:1784045366.721601:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873847168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045366.721607:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1784045366.721694:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873847168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045366.721708:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045366.721717:0:6493:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045366.721771:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873847296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045366.721796:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045366.721819:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d1780 going to sleep for 11 seconds 00000100:00100000:2.0:1784045366.721859:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873847296 00000100:00100000:2.0:1784045366.721863:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873847296 00000100:00100000:2.0:1784045366.721894:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1784045366.721901:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873847296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045366.721997:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873847296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045366.722004:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1784045366.722064:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873847296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045366.722090:0:6493:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873847424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045366.722134:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045366.722156:0:6493:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d1780 going to sleep for 11 seconds 00000100:00100000:2.0:1784045366.722347:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873847424 00000100:00100000:2.0:1784045366.722357:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873847424 00000100:00100000:2.0:1784045366.722390:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1784045366.722397:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873847424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045366.722501:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:6493:x1870706873847424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045366.722508:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1784045366.722553:0:6493:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0e855152-ca69-43a0-b465-3bf4e35d62f0:6493:1870706873847424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045366.723061:0:13776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13776:1870706873847552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045366.723105:0:13776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045366.723139:0:13776:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d1540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045366.723179:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873847552 00000100:00100000:2.0:1784045366.723184:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873847552 00000100:00100000:2.0:1784045366.723218:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1784045366.723225:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:13776:x1870706873847552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045366.723313:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:13776:x1870706873847552:12345-0@lo:502:llog_process_th.0 Request processed in 88us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045366.723319:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1784045366.723413:0:13776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13776:1870706873847552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784045366.723434:0:13776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045366.723482:0:13776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045366.723485:0:13776:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784045366.723493:0:13776:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939c9775c000 00000020:00000080:1.0:1784045366.723495:0:13776:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784045366.723547:0:13776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045366.723551:0:13776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045366.723553:0:13776:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784045366.723555:0:13776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045366.723558:0:13776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045366.723559:0:13776:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1784045366.723562:0:13776:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939c9775c000 00000020:00000080:1.0:1784045366.723564:0:13776:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784045366.723607:0:13776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13776:1870706873847680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045366.723642:0:13776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045366.724574:0:13776:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92daa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045366.724879:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873847680 00000100:00100000:3.0:1784045366.724886:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873847680 00000100:00100000:3.0:1784045366.724964:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1784045366.724973:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:13776:x1870706873847680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045366.725115:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:13776:x1870706873847680:12345-0@lo:502:llog_process_th.0 Request processed in 143us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045366.725122:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1784045366.725197:0:13776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0e855152-ca69-43a0-b465-3bf4e35d62f0:13776:1870706873847680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784045366.725223:0:13776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045366.725235:0:13776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045366.725237:0:13776:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1784045366.725240:0:13776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1784045366.725965:0:6493:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1784045366.725997:0:6493:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784045366.726009:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045366.726020:0:6493:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784045366.743604:0:13778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784045367.253936:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045367.488483:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045367.488521:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045367.488560:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045367.488598:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045367.488659:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045367.488681:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045367.488708:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863272448 00000100:00100000:2.0:1784045367.488716:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863272448 00000100:00100000:2.0:1784045367.488768:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863272960 00000100:00100000:2.0:1784045367.488772:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863272960 00000100:00100000:2.0:1784045367.488784:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863272576 00000100:00100000:2.0:1784045367.488786:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863272576 00000100:00100000:2.0:1784045367.488795:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863272832 00000100:00100000:2.0:1784045367.488797:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863272832 00000100:00100000:2.0:1784045367.488813:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 230 00000100:00100000:2.0:1784045367.488822:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863272448:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045367.488894:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863272448:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 73us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045367.488902:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 230 00000100:00100000:2.0:1784045367.488919:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 231 00000100:00100000:2.0:1784045367.488926:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863272960:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045367.488951:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863272960:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045367.488957:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 231 00000100:00100000:2.0:1784045367.488968:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 232 00000100:00100000:2.0:1784045367.488974:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863272576:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045367.488999:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863272576:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 25us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045367.489005:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 232 00000100:00100000:2.0:1784045367.489016:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 233 00000100:00100000:2.0:1784045367.489029:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863272832:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045367.489056:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863272832:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045367.489062:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 233 00000100:00080000:2.0:1784045367.489079:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045367.489083:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045367.489163:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863272704 00000100:00100000:1.0:1784045367.489168:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863272704 00000100:00100000:1.0:1784045367.489219:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 112 00000100:00100000:1.0:1784045367.489226:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863272704:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045367.489253:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863272704:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 29us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045367.489259:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 112 00000100:00080000:2.0:1784045367.489634:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045367.489912:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863272320 00000100:00100000:3.0:1784045367.489917:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863272320 00000100:00100000:3.0:1784045367.490032:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 369 00000100:00100000:3.0:1784045367.490041:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2397:x1870706863272320:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045367.490081:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2397:x1870706863272320:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 41us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045367.490090:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 369 00000040:00080000:2.0:1784045367.773848:0:13778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1784045367.775417:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784045367.955760:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873847936:0@lo:400:kworker.0 00000100:00100000:3.0:1784045367.955833:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045367.955984:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873847808:0@lo:400:kworker.0 00000100:00100000:0.0:1784045367.956022:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045367.957212:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873847936 00000100:00100000:0.0:1784045367.957223:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873847936 00000100:00100000:0.0:1784045367.957281:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1784045367.957290:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873847936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045367.959860:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873848448:0@lo:400:kworker.0 00000100:00100000:3.0:1784045367.959933:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045367.960054:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873848192:0@lo:400:kworker.0 00000100:00100000:1.0:1784045367.960087:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045367.960118:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045367.960124:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873848320:0@lo:400:kworker.0 00000100:00100000:1.0:1784045367.960158:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045367.960190:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873848320 00000100:00100000:1.0:1784045367.960197:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873848320 00000100:00100000:1.0:1784045367.960250:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784045367.960260:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873848320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045367.960317:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873848320:12345-0@lo:400:kworker.0 Request processed in 58us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045367.960325:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784045367.960364:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873848320:0@lo:400:kworker.0 00000100:00100000:1.0:1784045367.960398:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873848064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045367.960422:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045367.960494:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873848448 00000100:00100000:1.0:1784045367.960499:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873848448 00000100:00100000:1.0:1784045367.960518:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873848192 00000100:00100000:1.0:1784045367.960521:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873848192 00000100:00100000:1.0:1784045367.960530:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873848064 00000100:00100000:1.0:1784045367.960533:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873848064 00000100:00100000:1.0:1784045367.960543:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1784045367.960549:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873848448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045367.960597:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873848448:12345-0@lo:400:kworker.0 Request processed in 33us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045367.960604:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1784045367.960619:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1784045367.960625:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3625:x1870706873848192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045367.960667:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3625:x1870706873848192:12345-0@lo:400:kworker.0 Request processed in 41us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045367.960673:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1784045367.960685:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784045367.960691:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873848064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045367.960714:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784045367.960748:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873848064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045367.960754:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784045367.960785:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873848064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045367.960809:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873848192:0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.962397:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873848704:0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.962470:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045367.962500:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873849216:0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.962522:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045367.962543:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784045367.962549:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873848832:0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.962574:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045367.962613:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873849344:0@lo:400:kworker.0 00000100:00100000:1.0:1784045367.962623:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873848576:0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.962637:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045367.962669:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873848704 00000100:00100000:2.0:1784045367.962675:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873848704 00000100:00100000:2.0:1784045367.962714:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873849216 00000100:00100000:2.0:1784045367.962718:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873849216 00000100:00100000:2.0:1784045367.962734:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1784045367.962743:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873848704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045367.962759:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045367.962798:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873849088:0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.962816:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873848704:12345-0@lo:400:kworker.0 Request processed in 73us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045367.962824:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1784045367.962828:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045367.962845:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784045367.962852:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873848576 00000100:00100000:1.0:1784045367.962854:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873848960:0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.962858:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873848576 00000100:00100000:2.0:1784045367.962883:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873849088 00000100:00100000:1.0:1784045367.962885:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045367.962887:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873849088 00000100:00100000:1.0:1784045367.962909:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873849472:0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.962919:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784045367.962928:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873849216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045367.962935:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045367.962966:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873848832 00000100:00100000:1.0:1784045367.962970:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873848832 00000100:00100000:2.0:1784045367.962972:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873849216:12345-0@lo:400:kworker.0 Request processed in 45us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045367.962981:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784045367.962998:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784045367.963006:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873848576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045367.963007:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873849344 00000100:00100000:1.0:1784045367.963013:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873849344 00000100:00100000:1.0:1784045367.963032:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873848960 00000100:00100000:1.0:1784045367.963036:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873848960 00000100:00100000:2.0:1784045367.963049:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873848576:12345-0@lo:400:kworker.0 Request processed in 44us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045367.963052:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873849472 00000100:00100000:1.0:1784045367.963056:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873849472 00000100:00100000:2.0:1784045367.963059:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784045367.963084:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1784045367.963085:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784045367.963095:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873849088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045367.963098:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873848832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.963364:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873849088:12345-0@lo:400:kworker.0 Request processed in 271us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045367.963370:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:2.0:1784045367.963392:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045367.963396:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045367.963398:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045367.963400:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1784045367.963432:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831faa00 x1870706873848704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045367.963464:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873848704:0@lo:400:kworker.0 00010000:00080000:2.0:1784045367.963476:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831fb480 x1870706873849216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045367.963492:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873849216:0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.963540:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873847808 00000100:00100000:2.0:1784045367.963545:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873847808 00000100:00100000:2.0:1784045367.963844:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1784045367.963853:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873847808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.963950:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873847808:12345-0@lo:400:kworker.0 Request processed in 51us (7880us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045367.963957:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1784045367.964005:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873847808:0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.964047:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1784045367.964055:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873849344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.964093:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873849344:12345-0@lo:400:kworker.0 Request processed in 39us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045367.964100:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1784045367.964121:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784045367.964128:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873848960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.964231:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873848960:12345-0@lo:400:kworker.0 Request processed in 104us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045367.964237:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784045367.964250:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784045367.964257:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873849472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.964283:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873849472:12345-0@lo:400:kworker.0 Request processed in 27us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045367.964300:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:2.0:1784045367.964329:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831f9f80 x1870706873849344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045367.964340:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873849344:0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.964397:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873848960:0@lo:400:kworker.0 00010000:00080000:2.0:1784045367.964408:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831fad80 x1870706873849472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045367.964417:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873849472:0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.964427:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873848576:0@lo:400:kworker.0 00000100:00100000:2.0:1784045367.964437:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873849088:0@lo:400:kworker.0 00000100:00100000:3.0:1784045367.965484:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873847936:0@lo:400:kworker.0 00000100:00100000:3.0:1784045367.965518:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873848448:0@lo:400:kworker.0 00000100:00100000:0.0:1784045367.970910:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873847936:12345-0@lo:400:kworker.0 Request processed in 13609us (15065us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045367.970929:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1784045367.970995:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873848832:12345-0@lo:400:kworker.0 Request processed in 7898us (8417us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045367.971005:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784045367.971828:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873848832:0@lo:400:kworker.0 00010000:00010000:1.0:1784045368.275633:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045368.467762:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045368.467789:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873849600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045368.467860:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045368.468010:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873849600 00000100:00100000:2.0:1784045368.468018:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873849600 00000100:00100000:3.0:1784045368.468079:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873849728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045368.468111:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045368.473661:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873849728 00000100:00100000:2.0:1784045368.473675:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873849728 00000100:00100000:2.0:1784045368.473717:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784045368.473727:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873849600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784045368.473760:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045368.473849:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873849600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (5991us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045368.473855:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784045368.473871:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784045368.473878:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873849728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045368.473903:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045368.473931:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873849728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (5820us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045368.473937:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1784045368.477877:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b823bce00 x1870706873849728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045368.477906:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873849728:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1784045368.478284:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82880e00 x1870706873849600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045368.478303:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873849600:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784045369.299736:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045370.325011:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045371.028042:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045371.028065:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873849856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045371.028134:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045371.028813:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873849984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045371.028855:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045371.028906:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873849856 00000100:00100000:3.0:1784045371.028913:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873849856 00000100:00100000:3.0:1784045371.028960:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873849984 00000100:00100000:3.0:1784045371.028963:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873849984 00000100:00100000:3.0:1784045371.028982:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784045371.028991:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873849856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784045371.029020:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045371.029023:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784045371.029038:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1870706873849984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045371.029055:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045371.029072:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873849856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045371.029080:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784045371.029103:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1870706873849984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045371.029119:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784045371.029132:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873849984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045371.029321:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873849856:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784045371.029539:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1784045371.030759:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1784045371.347904:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045371.539799:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045371.539831:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873850112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045371.539914:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045371.540033:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873850112 00000100:00100000:0.0:1784045371.540041:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873850112 00000100:00100000:0.0:1784045371.540097:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1784045371.540106:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873850112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045371.540136:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045371.540184:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873850112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045371.540189:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1784045371.540310:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873850112:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784045372.372263:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045372.609923:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045372.610028:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045372.610072:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045372.610115:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863273472 00000100:00100000:0.0:1784045372.610124:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863273472 00000100:00100000:0.0:1784045372.610208:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 117 00000100:00100000:0.0:1784045372.610219:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863273472:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045372.610297:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863273472:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 80us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045372.610304:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 117 00000100:00080000:0.0:1784045372.610367:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045372.615497:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045372.615528:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045372.616060:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863273216 00000100:00100000:2.0:1784045372.616070:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863273216 00000100:00100000:2.0:1784045372.616204:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863273728 00000100:00100000:2.0:1784045372.616208:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863273728 00000100:00080000:0.0:1784045372.616481:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045372.616501:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 240 00000100:00100000:0.0:1784045372.616514:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863273216:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045372.616570:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 241 00000100:00100000:2.0:1784045372.616582:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863273728:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045372.616605:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863273216:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 94us (6688us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045372.616614:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 240 00000100:00100000:2.0:1784045372.616620:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863273728:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 39us (6545us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045372.616628:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 241 00000100:00080000:1.0:1784045372.616952:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784045372.616972:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863273088 00000100:00100000:1.0:1784045372.616977:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863273088 00000100:00100000:1.0:1784045372.617007:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 371 00000100:00100000:1.0:1784045372.617014:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863273088:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045372.617971:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863273088:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 952us (2478us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045372.617981:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 371 00000100:00100000:3.0:1784045372.619719:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045372.630862:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863273344 00000100:00100000:1.0:1784045372.630877:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863273344 00000100:00100000:1.0:1784045372.630949:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863273600 00000100:00100000:1.0:1784045372.630953:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863273600 00000100:00100000:3.0:1784045372.630974:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 242 00000100:00100000:3.0:1784045372.630989:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863273344:12345-192.168.203.44@tcp:400:kworker.0 00000100:00080000:2.0:1784045372.631014:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045372.631020:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784045372.631090:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863273344:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 105us (15560us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045372.632949:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 243 00000100:00100000:1.0:1784045372.632968:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863273600:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045372.633024:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 242 00000100:00100000:1.0:1784045372.633043:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863273600:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 83us (13332us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045372.633052:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 243 00000100:00100000:3.0:1784045373.075662:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045373.075686:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873850240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045373.075754:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045373.075994:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873850240 00000100:00100000:2.0:1784045373.076002:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873850240 00000100:00100000:2.0:1784045373.076055:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784045373.076064:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873850240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784045373.076098:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1784045373.076158:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873850240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045373.076181:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784045373.076342:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873850240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045373.078934:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873850624:0@lo:400:kworker.0 00000100:00100000:3.0:1784045373.078995:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045373.079033:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873851136:0@lo:400:kworker.0 00000100:00100000:3.0:1784045373.079070:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045373.079086:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873851648:0@lo:400:kworker.0 00000100:00100000:3.0:1784045373.079106:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045373.079127:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784045373.079133:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873850496:0@lo:400:kworker.0 00000100:00100000:3.0:1784045373.079153:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045373.079169:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873851008:0@lo:400:kworker.0 00000100:00100000:3.0:1784045373.079218:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045373.079235:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873851520:0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.079372:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873850624 00000100:00100000:0.0:1784045373.079379:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873850624 00000100:00100000:0.0:1784045373.079421:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873850496 00000100:00100000:0.0:1784045373.079424:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873850496 00000100:00100000:0.0:1784045373.079437:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873851008 00000100:00100000:0.0:1784045373.079478:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873851008 00000100:00100000:0.0:1784045373.079512:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1784045373.079514:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873851136 00000100:00100000:2.0:1784045373.079520:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873851136 00000100:00100000:0.0:1784045373.079523:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873850624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045373.079563:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873851648 00000100:00100000:2.0:1784045373.079568:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873851648 00000100:00100000:0.0:1784045373.079600:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873850624:12345-0@lo:400:kworker.0 Request processed in 79us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045373.079607:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784045373.079612:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1784045373.079619:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873851136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.079633:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1784045373.079641:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873850496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045373.079676:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873851136:12345-0@lo:400:kworker.0 Request processed in 52us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045373.079683:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873850496:12345-0@lo:400:kworker.0 Request processed in 40us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045373.079688:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784045373.079696:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1784045373.079707:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784045373.079714:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873851648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.079720:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1784045373.079730:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873851008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045373.079755:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873851648:12345-0@lo:400:kworker.0 Request processed in 42us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045373.079760:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784045373.079774:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873851008:12345-0@lo:400:kworker.0 Request processed in 45us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045373.079791:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1784045373.079810:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873850752:0@lo:400:kworker.0 00000100:00080000:0.0:1784045373.079819:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045373.079825:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045373.079828:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045373.079836:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045373.079851:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873851264:0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.079852:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873850752 00000100:00100000:0.0:1784045373.079858:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873850752 00000100:00100000:2.0:1784045373.079867:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045373.079886:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873851776:0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.079892:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784045373.079904:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045373.079905:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873850752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045373.079925:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784045373.079931:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873850368:0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.079952:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873850752:12345-0@lo:400:kworker.0 Request processed in 51us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045373.079964:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045373.079965:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784045373.079991:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873851264 00000100:00100000:2.0:1784045373.079992:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873850880:0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.079996:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873851264 00000100:00100000:0.0:1784045373.080027:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873851776 00000100:00100000:2.0:1784045373.080032:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045373.080033:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873851776 00000100:00100000:2.0:1784045373.080062:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873851392:0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.080063:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784045373.080073:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873851264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.080105:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873851264:12345-0@lo:400:kworker.0 Request processed in 33us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045373.080110:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784045373.080121:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784045373.080127:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873851776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.080154:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873851776:12345-0@lo:400:kworker.0 Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045373.080159:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1784045373.080177:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045373.080179:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045373.080202:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873850368 00000100:00100000:0.0:1784045373.080205:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873850368 00000100:00100000:0.0:1784045373.080230:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1784045373.080236:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873850368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.080265:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873850368:12345-0@lo:400:kworker.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045373.080271:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1784045373.080322:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873850880 00000100:00100000:0.0:1784045373.080326:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873850880 00000100:00100000:0.0:1784045373.080352:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1784045373.080358:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873850880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.080387:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873850880:12345-0@lo:400:kworker.0 Request processed in 29us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045373.080395:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:0.0:1784045373.080413:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045373.080632:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045373.080662:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873851392 00000100:00100000:3.0:1784045373.080667:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873851392 00000100:00100000:3.0:1784045373.080700:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1784045373.080706:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873851392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045373.080741:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873851392:12345-0@lo:400:kworker.0 Request processed in 35us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045373.080747:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:3.0:1784045373.080760:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045373.080780:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873850752:0@lo:400:kworker.0 00000100:00100000:2.0:1784045373.080795:0:3625:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1784045373.080799:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939cbf4d6d80, transno 4294967301 00000100:00100000:2.0:1784045373.080818:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873851264:0@lo:400:kworker.0 00010000:00080000:2.0:1784045373.080829:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a0000 x1870706873851776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045373.080838:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873851776:0@lo:400:kworker.0 00000100:00100000:2.0:1784045373.080867:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873850368:0@lo:400:kworker.0 00000100:00100000:2.0:1784045373.080875:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873850880:0@lo:400:kworker.0 00000100:00100000:2.0:1784045373.080883:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873851392:0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.081190:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045373.081242:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873850624:0@lo:400:kworker.0 00000100:00100000:2.0:1784045373.081326:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873851520 00000100:00100000:2.0:1784045373.081332:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873851520 00000100:00100000:2.0:1784045373.081379:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1784045373.081387:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873851520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045373.081440:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873851520:12345-0@lo:400:kworker.0 Request processed in 53us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045373.081468:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1784045373.081669:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873851136:0@lo:400:kworker.0 00010000:00080000:0.0:1784045373.081683:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a1880 x1870706873851648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045373.081693:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873851648:0@lo:400:kworker.0 00000100:00100000:0.0:1784045373.081721:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873850496:0@lo:400:kworker.0 00010000:00080000:0.0:1784045373.081732:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6848a80 x1870706873851008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045373.081741:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873851008:0@lo:400:kworker.0 00010000:00080000:0.0:1784045373.081764:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a1c00 x1870706873851520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045373.081772:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873851520:0@lo:400:kworker.0 00000100:00080000:3.0:1784045373.083849:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784045373.397269:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045373.587847:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873851904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045373.587908:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045373.587976:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873852032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045373.588014:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045373.588067:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873851904 00000100:00100000:2.0:1784045373.588075:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873851904 00000100:00100000:2.0:1784045373.588125:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873852032 00000100:00100000:2.0:1784045373.588142:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873852032 00000100:00100000:2.0:1784045373.588161:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784045373.588169:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873851904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784045373.588199:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045373.588247:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873851904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045373.588254:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784045373.588268:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784045373.588274:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873852032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045373.588283:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045373.588311:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873852032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045373.588316:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1784045373.588348:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cb6848a80 x1870706873852032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045373.588366:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873852032:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1784045373.588470:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a0700 x1870706873851904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045373.588484:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873851904:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784045374.419691:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045375.443929:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045376.147875:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873852160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045376.147951:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045376.148175:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873852160 00000100:00100000:0.0:1784045376.148182:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873852160 00000100:00100000:0.0:1784045376.148251:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784045376.148261:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873852160:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784045376.148379:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1784045376.148417:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045376.148495:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873852160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 235us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045376.148503:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784045376.148591:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873852160:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784045376.150365:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045376.150395:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873852288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045376.150550:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045376.150661:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873852288 00000100:00100000:3.0:1784045376.150671:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873852288 00000100:00100000:3.0:1784045376.150760:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784045376.150778:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873852288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045376.150807:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045376.150862:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873852288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045376.150870:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1784045376.151152:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045376.151200:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873852288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784045376.470400:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045376.660617:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045376.660647:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873852416:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045376.660737:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045376.660817:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873852416 00000100:00100000:2.0:1784045376.660826:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873852416 00000100:00100000:2.0:1784045376.660884:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784045376.660895:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873852416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784045376.660940:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784045376.661006:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873852416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045376.661015:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784045376.661070:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873852416:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784045377.494808:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045377.728883:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045377.728940:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045377.729062:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863273856 00000100:00100000:1.0:1784045377.729075:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863273856 00000100:00100000:1.0:1784045377.729152:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 373 00000100:00100000:1.0:1784045377.729164:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8827b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2396:x1870706863273856:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045377.729265:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8827b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2396:x1870706863273856:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 103us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045377.729275:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 373 00000100:00100000:3.0:1784045377.731972:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045377.739091:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045377.739703:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863274368 00000100:00100000:0.0:1784045377.739718:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863274368 00000100:00100000:2.0:1784045377.739738:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863274112 00000100:00100000:2.0:1784045377.739751:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863274112 00000100:00100000:2.0:1784045377.739924:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 250 00000100:00100000:2.0:1784045377.739942:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863274112:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045377.740058:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863274112:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 123us (11116us total) trans 0 rc 0/0 00000100:00080000:1.0:1784045377.740310:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784045377.740317:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045377.740355:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 251 00000100:00100000:0.0:1784045377.740368:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2396:x1870706863274368:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045377.740409:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2396:x1870706863274368:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 45us (8451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045377.740417:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 251 00000100:00100000:2.0:1784045377.740487:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 250 00000100:00100000:3.0:1784045377.744865:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045377.747195:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863273984 00000100:00100000:0.0:1784045377.747216:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863273984 00000100:00100000:0.0:1784045377.747333:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 252 00000100:00100000:0.0:1784045377.747344:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863273984:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045377.747489:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863273984:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 145us (8413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045377.747498:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 252 00000100:00100000:1.0:1784045377.750509:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863274240 00000100:00100000:1.0:1784045377.750544:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863274240 00000100:00100000:3.0:1784045377.750702:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045377.750760:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 122 00000100:00100000:1.0:1784045377.750774:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863274240:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045377.750959:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863274240:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 188us (6107us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045377.750979:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 122 00000100:00080000:2.0:1784045377.752978:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045377.752993:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045377.753019:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863274496 00000100:00100000:2.0:1784045377.753032:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863274496 00000100:00100000:2.0:1784045377.753140:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 253 00000100:00100000:2.0:1784045377.753151:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2396:x1870706863274496:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045377.753249:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2396:x1870706863274496:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 100us (2553us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045377.753259:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 253 00000100:00080000:1.0:1784045377.754279:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1784045378.004383:0:13778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1784045378.005370:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784045378.195890:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873852544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045378.195991:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045378.196718:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873853056:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.196769:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045378.196801:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873853568:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.196827:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045378.196849:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873854080:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.196872:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045378.196900:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784045378.196906:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873852672:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.196939:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045378.196961:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873853184:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.196987:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045378.197006:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873853696:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.197027:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045378.197054:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873852928:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.197078:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045378.197094:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873853440:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.197115:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045378.197130:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873853952:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.197149:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045378.197385:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784045378.197393:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873852800:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.197421:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045378.197439:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873853312:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.197538:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045378.197551:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873853824:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.197593:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045378.197631:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873853568 00000100:00100000:0.0:1784045378.197640:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873853568 00000100:00100000:0.0:1784045378.197705:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873854080 00000100:00100000:0.0:1784045378.197709:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873854080 00000100:00100000:0.0:1784045378.197725:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873853440 00000100:00100000:0.0:1784045378.197728:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873853440 00000100:00100000:0.0:1784045378.197742:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873853952 00000100:00100000:0.0:1784045378.197745:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873853952 00000100:00100000:0.0:1784045378.197762:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784045378.197771:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873853568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.197839:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873853568:12345-0@lo:400:kworker.0 Request processed in 69us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045378.197848:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784045378.197868:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784045378.197873:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873854080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.197902:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873854080:12345-0@lo:400:kworker.0 Request processed in 29us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045378.197908:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784045378.197920:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784045378.197926:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873853440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.197958:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873853440:12345-0@lo:400:kworker.0 Request processed in 31us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045378.197964:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1784045378.197975:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1784045378.197988:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873853952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.198017:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873853952:12345-0@lo:400:kworker.0 Request processed in 30us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045378.198023:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1784045378.198049:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873852672 00000100:00100000:0.0:1784045378.198053:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873852672 00000100:00100000:0.0:1784045378.198081:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1784045378.198088:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873852672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.198119:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88278450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873852672:12345-0@lo:400:kworker.0 Request processed in 31us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045378.198126:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1784045378.198158:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873853184 00000100:00100000:1.0:1784045378.198290:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873852544 00000100:00100000:1.0:1784045378.198295:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873852544 00000100:00100000:1.0:1784045378.198331:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873853056 00000100:00100000:1.0:1784045378.198334:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873853056 00000100:00100000:1.0:1784045378.198349:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784045378.198355:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873852544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045378.198393:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784045378.198436:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873852544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045378.198462:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784045378.198482:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784045378.198489:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873853056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045378.198529:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873853056:12345-0@lo:400:kworker.0 Request processed in 31us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045378.198536:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1784045378.198563:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045378.198567:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045378.198628:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873853696 00000100:00100000:1.0:1784045378.198632:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873853696 00000100:00100000:1.0:1784045378.198660:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873852928 00000100:00100000:1.0:1784045378.198663:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873852928 00000100:00100000:1.0:1784045378.198674:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873852800 00000100:00100000:1.0:1784045378.198677:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873852800 00000100:00100000:1.0:1784045378.198701:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873853312 00000100:00100000:1.0:1784045378.198704:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873853312 00000100:00100000:1.0:1784045378.198720:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873853824 00000100:00100000:1.0:1784045378.198723:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873853824 00000100:00100000:1.0:1784045378.198737:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1784045378.198743:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873853696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045378.198781:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873853696:12345-0@lo:400:kworker.0 Request processed in 37us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045378.198787:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1784045378.198800:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1784045378.198805:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873852928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045378.198831:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873852928:12345-0@lo:400:kworker.0 Request processed in 26us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045378.198837:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1784045378.198847:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784045378.198852:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873852800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045378.198880:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873852800:12345-0@lo:400:kworker.0 Request processed in 27us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045378.198886:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784045378.198898:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1784045378.198904:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873853312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045378.198931:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873853312:12345-0@lo:400:kworker.0 Request processed in 28us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045378.198937:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1784045378.198949:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1784045378.198955:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873853824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045378.198993:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873853824:12345-0@lo:400:kworker.0 Request processed in 38us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045378.198999:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00080000:1.0:1784045378.199021:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784045378.199024:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045378.199077:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873852672:0@lo:400:kworker.0 00000100:00100000:1.0:1784045378.199095:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873853696:0@lo:400:kworker.0 00000100:00100000:1.0:1784045378.199107:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873853056:0@lo:400:kworker.0 00000100:00100000:1.0:1784045378.199118:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873853568:0@lo:400:kworker.0 00010000:00080000:1.0:1784045378.199134:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a4000 x1870706873854080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045378.199145:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873854080:0@lo:400:kworker.0 00000100:00100000:1.0:1784045378.199961:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873852544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045378.200084:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873852800:0@lo:400:kworker.0 00010000:00080000:1.0:1784045378.200101:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c915b9180 x1870706873853312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045378.200112:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873853312:0@lo:400:kworker.0 00010000:00080000:1.0:1784045378.200123:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a7b80 x1870706873853824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045378.200130:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873853824:0@lo:400:kworker.0 00000100:00100000:1.0:1784045378.200142:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873852928:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.200610:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873853184 00000100:00100000:1.0:1784045378.200682:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873853440:0@lo:400:kworker.0 00010000:00080000:1.0:1784045378.200707:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a7480 x1870706873853952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045378.200716:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873853952:0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.200978:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1784045378.200988:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873853184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045378.201089:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873853184:12345-0@lo:400:kworker.0 Request processed in 102us (4101us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045378.201096:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:0.0:1784045378.201119:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045378.204014:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873853184:0@lo:400:kworker.0 00010000:00010000:1.0:1784045378.516299:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045378.707940:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045378.707972:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873854208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045378.708081:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045378.708305:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873854208 00000100:00100000:1.0:1784045378.708318:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873854208 00000100:00100000:1.0:1784045378.708406:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784045378.708419:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873854208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045378.708524:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045378.708583:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873854208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045378.708592:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1784045378.708654:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4cd880 x1870706873854208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045378.708676:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873854208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045378.710015:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045378.710038:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873854336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045378.710852:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045378.710992:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873854336 00000100:00100000:3.0:1784045378.711003:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873854336 00000100:00100000:3.0:1784045378.711086:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1784045378.711098:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873854336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784045378.711124:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1784045378.712898:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a0000 x1870706873854336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045378.712947:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873854336:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045378.713847:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873854336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2743us (2987us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045378.713863:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00010000:1.0:1784045379.539760:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045380.564280:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045381.267768:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045381.267802:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873854464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045381.267908:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045381.267958:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873854464 00000100:00100000:1.0:1784045381.267967:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873854464 00000100:00080000:0.0:1784045381.268004:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045381.268128:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873854592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045381.268180:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784045381.268193:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873854464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045381.268232:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045381.268526:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873854464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 334us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045381.270929:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045381.271016:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873854592 00000100:00100000:0.0:1784045381.271029:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873854592 00000100:00100000:0.0:1784045381.271158:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784045381.271179:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873854592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784045381.271240:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045381.271301:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873854592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045381.271309:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784045381.272648:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:2.0:1784045381.272947:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045381.272968:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873854592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045381.273613:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873854464:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784045381.590520:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045381.780619:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873854720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784045381.780695:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045381.784237:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873854720 00000100:00100000:0.0:1784045381.784253:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873854720 00000100:00100000:0.0:1784045381.784315:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784045381.784327:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873854720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045381.784368:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045381.784622:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873854720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 296us (3925us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045381.784630:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784045381.786885:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873854720:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784045382.611958:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045382.849153:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045382.849216:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045382.849281:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045382.849357:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863274624 00000100:00100000:1.0:1784045382.849367:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863274624 00000100:00100000:1.0:1784045382.849424:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 375 00000100:00100000:1.0:1784045382.849435:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863274624:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045382.849562:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88279c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863274624:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 129us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045382.850394:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863274880 00000100:00100000:2.0:1784045382.850401:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863274880 00000100:00100000:2.0:1784045382.850461:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863274752 00000100:00100000:2.0:1784045382.850474:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863274752 00000100:00100000:2.0:1784045382.850507:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 260 00000100:00100000:2.0:1784045382.850515:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863274880:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045382.850563:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863274880:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 50us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045382.850570:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 260 00000100:00100000:2.0:1784045382.850584:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 261 00000100:00100000:2.0:1784045382.850590:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863274752:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045382.850609:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf547100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863274752:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 19us (1330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045382.850614:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 261 00000100:00100000:1.0:1784045382.851806:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 375 00000100:00080000:0.0:1784045382.852244:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045382.852251:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045382.872350:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045382.872511:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045382.872688:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045382.872932:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863275008 00000100:00100000:1.0:1784045382.872942:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863275008 00000100:00100000:1.0:1784045382.873021:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:1.0:1784045382.873032:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2393:x1870706863275008:12345-192.168.203.44@tcp:9:kworker.0 00000020:00000080:1.0:1784045382.873077:0:9935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c7da 00000100:00080000:1.0:1784045382.873087:0:9935:0:(import.c:65:import_set_state_nolock()) ffff939b833ad000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784045382.873187:0:9935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1784045382.873423:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+2:2393:x1870706863275008:12345-192.168.203.44@tcp:9:kworker.0 Request processed in 392us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045382.873432:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27 00010000:00010000:1.0:1784045382.873486:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784045382.873635:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045382.874142:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863275136 00000100:00100000:2.0:1784045382.874148:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863275136 00000100:00080000:3.0:1784045382.874208:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045382.874290:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863275264 00000100:00100000:1.0:1784045382.874294:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863275264 00000100:00100000:1.0:1784045382.874376:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 262 00000100:00100000:1.0:1784045382.874384:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863275136:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045382.874435:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863275136:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 53us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045382.874442:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 262 00000100:00100000:1.0:1784045382.874474:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 263 00000100:00100000:1.0:1784045382.874481:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863275264:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045382.874517:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863275264:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 37us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045382.874523:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 263 00000100:00080000:3.0:1784045382.875047:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045383.315755:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045383.315780:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873854848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045383.315847:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045383.316132:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873854848 00000100:00100000:0.0:1784045383.316140:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873854848 00000100:00100000:1.0:1784045383.317534:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873855360:0@lo:400:kworker.0 00000100:00100000:1.0:1784045383.317586:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045383.317638:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873855232:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.317668:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045383.317704:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873855744:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.317727:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045383.317760:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873856256:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.317781:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045383.317803:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784045383.317809:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873855104:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.317829:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045383.317846:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873855616:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.317865:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045383.317881:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873856128:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.317901:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045383.317930:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873855232 00000100:00100000:3.0:1784045383.317935:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873855232 00000100:00100000:3.0:1784045383.317968:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873855104 00000100:00100000:3.0:1784045383.317971:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873855104 00000100:00100000:3.0:1784045383.317982:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873855616 00000100:00100000:3.0:1784045383.317984:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873855616 00000100:00100000:3.0:1784045383.318004:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873856128 00000100:00100000:3.0:1784045383.318007:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873856128 00000100:00100000:3.0:1784045383.318025:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1784045383.318032:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873855232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.318080:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873855232:12345-0@lo:400:kworker.0 Request processed in 48us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045383.318087:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1784045383.318102:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1784045383.318107:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873855104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.318133:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf544380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873855104:12345-0@lo:400:kworker.0 Request processed in 26us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045383.318139:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1784045383.318160:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1784045383.318166:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873855616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.318515:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873855616:12345-0@lo:400:kworker.0 Request processed in 28us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045383.318523:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1784045383.318537:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784045383.318546:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873856128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.318579:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873856128:12345-0@lo:400:kworker.0 Request processed in 35us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045383.318584:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:3.0:1784045383.318601:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784045383.318615:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873854976:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.318659:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045383.318686:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873855488:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.318706:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045383.318719:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873856000:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.318739:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045383.318763:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873854976 00000100:00100000:3.0:1784045383.318768:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873854976 00000100:00100000:3.0:1784045383.318796:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1784045383.318802:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873854976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.318834:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873854976:12345-0@lo:400:kworker.0 Request processed in 32us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045383.318840:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1784045383.318883:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873854976:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.318923:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873855104:0@lo:400:kworker.0 00010000:00080000:3.0:1784045383.318936:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4cce00 x1870706873855616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045383.318947:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873855616:0@lo:400:kworker.0 00010000:00080000:3.0:1784045383.318957:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4cd500 x1870706873856128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045383.318965:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873856128:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.318973:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873855232:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.318992:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873855488 00000100:00100000:3.0:1784045383.318995:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873855488 00000100:00100000:3.0:1784045383.319017:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873856000 00000100:00100000:3.0:1784045383.319020:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873856000 00000100:00100000:3.0:1784045383.319035:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1784045383.319040:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873855488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.319072:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf545500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873855488:12345-0@lo:400:kworker.0 Request processed in 32us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045383.319078:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1784045383.319089:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1784045383.319095:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873856000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.319119:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf544700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873856000:12345-0@lo:400:kworker.0 Request processed in 25us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045383.319125:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:3.0:1784045383.319137:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045383.319152:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873855488:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.319170:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873856000:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.319504:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873855744 00000100:00100000:3.0:1784045383.319509:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873855744 00000100:00100000:3.0:1784045383.319540:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873856256 00000100:00100000:3.0:1784045383.319544:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873856256 00000100:00100000:3.0:1784045383.319564:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784045383.319571:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873855744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.319613:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873855744:12345-0@lo:400:kworker.0 Request processed in 43us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045383.319619:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784045383.319631:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784045383.319637:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873856256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.319738:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873856256:12345-0@lo:400:kworker.0 Request processed in 100us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045383.319744:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1784045383.319764:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045383.319767:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045383.319790:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873855744:0@lo:400:kworker.0 00010000:00080000:3.0:1784045383.319801:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4cc700 x1870706873856256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045383.319810:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873856256:0@lo:400:kworker.0 00000100:00100000:1.0:1784045383.322633:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873855872:0@lo:400:kworker.0 00000100:00100000:1.0:1784045383.323089:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045383.323120:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873856384:0@lo:400:kworker.0 00000100:00100000:1.0:1784045383.323163:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045383.323284:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873855872 00000100:00100000:1.0:1784045383.323291:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873855872 00000100:00100000:1.0:1784045383.323339:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873856384 00000100:00100000:1.0:1784045383.323342:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873856384 00000100:00100000:1.0:1784045383.323362:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784045383.323369:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873855872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045383.323417:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873855872:12345-0@lo:400:kworker.0 Request processed in 48us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045383.323424:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784045383.323468:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784045383.323474:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873856384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045383.323511:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873856384:12345-0@lo:400:kworker.0 Request processed in 38us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045383.323517:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1784045383.323538:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045383.323541:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045383.323567:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873855872:0@lo:400:kworker.0 00010000:00080000:1.0:1784045383.323579:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4cca80 x1870706873856384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045383.323588:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873856384:0@lo:400:kworker.0 00000100:00100000:3.0:1784045383.324612:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1784045383.324629:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873854848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784045383.324677:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1784045383.324750:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873854848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (8903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045383.324769:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784045383.324918:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873854848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045383.327320:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873855360 00000100:00100000:0.0:1784045383.327333:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873855360 00000100:00100000:0.0:1784045383.327501:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784045383.327514:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873855360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045383.327620:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873855360:12345-0@lo:400:kworker.0 Request processed in 110us (10033us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045383.327628:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784045383.327719:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873855360:0@lo:400:kworker.0 00010000:00010000:1.0:1784045383.638691:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045383.827949:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873856512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045383.828038:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045383.828206:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873856640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045383.828237:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045383.832186:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873856512 00000100:00100000:0.0:1784045383.832223:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873856512 00000100:00100000:0.0:1784045383.832279:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873856640 00000100:00100000:0.0:1784045383.832283:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873856640 00000100:00100000:0.0:1784045383.832303:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784045383.832311:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873856512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045383.832345:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045383.832503:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873856512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 191us (4463us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045383.832510:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784045383.832527:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784045383.832694:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873856640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784045383.832707:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045383.832751:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873856640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (4512us total) trans 0 rc 0/0 00010000:00080000:2.0:1784045383.832843:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4cdf80 x1870706873856512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045383.832865:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873856512:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1784045383.832926:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf544a80 x1870706873856640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045383.832940:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf544a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873856640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045383.834044:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00010000:1.0:1784045384.662293:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045385.683858:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045386.388075:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873856768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045386.388148:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045386.388330:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873856768 00000100:00100000:1.0:1784045386.388339:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873856768 00000100:00100000:1.0:1784045386.388407:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1784045386.388416:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873856768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045386.388485:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045386.388534:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873856768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045386.388541:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1784045386.388782:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045386.388831:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873856768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045386.398351:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045386.398372:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873856896:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045386.398437:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045386.403069:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873856896 00000100:00100000:3.0:1784045386.403081:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873856896 00000100:00100000:2.0:1784045386.403562:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784045386.403573:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873856896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784045386.403599:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045386.403678:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873856896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (5240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045386.403686:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784045386.403919:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873856896:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784045386.406238:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784045386.715875:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045386.904768:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873857024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045386.904883:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045386.905001:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873857024 00000100:00100000:1.0:1784045386.905009:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873857024 00000100:00100000:1.0:1784045386.905060:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784045386.905068:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873857024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784045386.905106:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784045386.921316:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873857024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 16236us (16421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045386.921331:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1784045386.922492:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873857024:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784045387.732860:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045387.969826:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045387.969862:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045387.969889:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045387.969910:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045387.969933:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045387.969959:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863275520 00000100:00100000:3.0:1784045387.969967:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863275520 00000100:00100000:3.0:1784045387.970015:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863275776 00000100:00100000:3.0:1784045387.970018:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863275776 00000100:00100000:3.0:1784045387.970033:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863275648 00000100:00100000:3.0:1784045387.970036:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863275648 00000100:00100000:3.0:1784045387.970048:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863275904 00000100:00100000:3.0:1784045387.970050:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863275904 00000100:00100000:3.0:1784045387.970065:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 270 00000100:00100000:3.0:1784045387.970075:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863275520:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045387.970149:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863275520:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 75us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045387.970157:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 270 00000100:00100000:3.0:1784045387.970175:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 271 00000100:00100000:3.0:1784045387.970181:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863275776:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045387.970205:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863275776:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045387.970225:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 271 00000100:00100000:3.0:1784045387.970237:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 272 00000100:00100000:3.0:1784045387.970242:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863275648:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045387.970266:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863275648:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045387.970272:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 272 00000100:00100000:3.0:1784045387.970283:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 273 00000100:00100000:3.0:1784045387.970290:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863275904:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045387.970311:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf547b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863275904:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 22us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045387.970317:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 273 00000100:00100000:3.0:1784045387.970337:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863275392 00000100:00100000:3.0:1784045387.970340:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863275392 00000100:00100000:3.0:1784045387.970419:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 377 00000100:00100000:3.0:1784045387.970426:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863275392:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045387.970483:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863275392:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 57us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045387.970490:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 377 00000100:00080000:3.0:1784045387.971827:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784045387.971836:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1784045388.245634:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1784045388.251603:0:13778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784045388.437960:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873857152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045388.438028:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438072:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873857664:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.438097:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438121:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873858176:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.438191:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438429:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873858688:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.438494:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438519:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1784045388.438526:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873857280:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.438553:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438574:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873857792:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.438594:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438612:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873858304:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.438633:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438648:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873858816:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.438667:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438695:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873857408:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.438718:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438734:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873857920:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.438754:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438770:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873858432:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.438791:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438809:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784045388.438814:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873857536:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.438845:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438865:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873858048:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.438908:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438919:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873858560:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.438938:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.438961:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873858176 00000100:00100000:1.0:1784045388.438973:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873858176 00000100:00100000:1.0:1784045388.439020:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873858688 00000100:00100000:1.0:1784045388.439023:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873858688 00000100:00100000:1.0:1784045388.439035:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873858304 00000100:00100000:1.0:1784045388.439037:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873858304 00000100:00100000:1.0:1784045388.439050:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873858816 00000100:00100000:1.0:1784045388.439052:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873858816 00000100:00100000:1.0:1784045388.439067:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784045388.439074:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873858176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.439128:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873858176:12345-0@lo:400:kworker.0 Request processed in 53us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045388.439135:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784045388.439159:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784045388.439166:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873858688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.439196:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873858688:12345-0@lo:400:kworker.0 Request processed in 31us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045388.439216:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784045388.443066:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784045388.443091:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873858304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.443184:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873858304:12345-0@lo:400:kworker.0 Request processed in 104us (4549us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045388.443192:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784045388.443219:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784045388.443227:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873858816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.443259:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873858816:12345-0@lo:400:kworker.0 Request processed in 34us (4590us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045388.443264:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784045388.443319:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873857152 00000100:00100000:1.0:1784045388.443327:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873857152 00000100:00100000:1.0:1784045388.443356:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873857792 00000100:00100000:1.0:1784045388.443359:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873857792 00000100:00100000:1.0:1784045388.443371:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873857536 00000100:00100000:1.0:1784045388.443374:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873857536 00000100:00100000:1.0:1784045388.443386:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784045388.443393:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3623:x1870706873857152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045388.443419:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784045388.443479:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3623:x1870706873857152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (5450us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045388.443486:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784045388.443499:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784045388.443505:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873857792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.443534:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873857792:12345-0@lo:400:kworker.0 Request processed in 29us (4938us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045388.443541:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784045388.443552:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784045388.443559:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873857536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.443600:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873857536:12345-0@lo:400:kworker.0 Request processed in 42us (4754us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045388.443606:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784045388.443658:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873857792:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.443671:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873858304:0@lo:400:kworker.0 00010000:00080000:1.0:1784045388.443683:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d6d80 x1870706873858816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045388.443707:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873858816:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.443725:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873857152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045388.443737:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873858176:0@lo:400:kworker.0 00010000:00080000:1.0:1784045388.443748:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4d6680 x1870706873858688/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045388.443756:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873858688:0@lo:400:kworker.0 00000100:00100000:1.0:1784045388.443799:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873857536:0@lo:400:kworker.0 00000100:00100000:3.0:1784045388.455079:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873857664 00000100:00100000:3.0:1784045388.455093:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873857664 00000100:00100000:3.0:1784045388.455138:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873857408 00000100:00100000:3.0:1784045388.455141:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873857408 00000100:00100000:3.0:1784045388.455154:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873857920 00000100:00100000:3.0:1784045388.455171:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873857920 00000100:00100000:3.0:1784045388.455192:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873858432 00000100:00100000:3.0:1784045388.455195:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873858432 00000100:00100000:3.0:1784045388.455207:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873858048 00000100:00100000:3.0:1784045388.455210:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873858048 00000100:00100000:3.0:1784045388.455223:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873858560 00000100:00100000:3.0:1784045388.455225:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873858560 00000100:00100000:3.0:1784045388.455245:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784045388.455254:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873857664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045388.455350:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873857664:12345-0@lo:400:kworker.0 Request processed in 97us (17251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045388.455356:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784045388.455375:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1784045388.455380:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873857408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045388.455416:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873857408:12345-0@lo:400:kworker.0 Request processed in 36us (16697us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045388.455422:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1784045388.455433:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1784045388.455439:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873857920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045388.455511:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873857920:12345-0@lo:400:kworker.0 Request processed in 73us (16755us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045388.455517:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1784045388.455530:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1784045388.455535:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873858432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045388.455561:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873858432:12345-0@lo:400:kworker.0 Request processed in 27us (16770us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045388.455566:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1784045388.455587:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1784045388.455592:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873858048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045388.455622:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873858048:12345-0@lo:400:kworker.0 Request processed in 30us (16713us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045388.455628:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1784045388.455639:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1784045388.455644:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873858560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045388.455670:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873858560:12345-0@lo:400:kworker.0 Request processed in 27us (16731us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045388.455676:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:3.0:1784045388.455698:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784045388.455702:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784045388.455704:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045388.455707:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045388.456102:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873857664:0@lo:400:kworker.0 00010000:00080000:3.0:1784045388.456137:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4cc000 x1870706873858048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045388.456147:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873858048:0@lo:400:kworker.0 00010000:00080000:3.0:1784045388.456157:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4cdf80 x1870706873858560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045388.456166:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873858560:0@lo:400:kworker.0 00000100:00100000:3.0:1784045388.456175:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873857408:0@lo:400:kworker.0 00000100:00100000:3.0:1784045388.456184:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873857920:0@lo:400:kworker.0 00000100:00100000:3.0:1784045388.456192:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873858432:0@lo:400:kworker.0 00000100:00100000:3.0:1784045388.458351:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873857280 00000100:00100000:3.0:1784045388.458365:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873857280 00000100:00100000:3.0:1784045388.458423:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1784045388.458434:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873857280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045388.459308:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873857280:12345-0@lo:400:kworker.0 Request processed in 870us (20748us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045388.459318:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1784045388.459379:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873857280:0@lo:400:kworker.0 00010000:00010000:1.0:1784045388.759495:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045388.947589:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873858944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045388.947660:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045388.949273:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873858944 00000100:00100000:1.0:1784045388.949281:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873858944 00000100:00100000:1.0:1784045388.949336:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1784045388.949346:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873858944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784045388.949376:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045388.949505:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873858944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 160us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045388.949513:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:1.0:1784045388.951436:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831f8e00 x1870706873858944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045388.951495:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873858944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045388.951521:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045388.951531:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873859072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045388.952762:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045388.952927:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873859072 00000100:00100000:2.0:1784045388.952935:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873859072 00000100:00100000:2.0:1784045388.953143:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1784045388.953153:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873859072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045388.953186:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045388.953238:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873859072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045388.953246:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:0.0:1784045388.953354:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c83ca4700 x1870706873859072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045388.953382:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873859072:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1784045388.958415:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000020:00000080:2.0:1784045388.958424:0:8407:0:(genops.c:906:class_export_put()) final put ffff939b833a9000/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000020:00000080:0.0:1784045388.959158:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939b833a9000/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 for lustre-OST0000 00000020:00000080:0.0:1784045388.959221:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b833ad000 for lustre-OST0000 00010000:00010000:1.0:1784045389.779640:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045390.805868:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045391.507687:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045391.507710:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873859200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784045391.507781:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045391.507955:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873859328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045391.507983:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045391.508016:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873859200 00000100:00100000:1.0:1784045391.508022:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873859200 00000100:00100000:1.0:1784045391.508071:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873859328 00000100:00100000:1.0:1784045391.508074:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873859328 00000100:00100000:1.0:1784045391.508091:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784045391.508099:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873859200:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045391.508104:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1784045391.508111:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873859328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045391.508125:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1784045391.508125:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045391.508166:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873859328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045391.508166:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873859200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045391.508173:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1784045391.508563:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045391.510538:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784045391.510625:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873859328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045391.510643:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873859200:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784045391.839015:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784045391.898072:0:14039:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:09:49 (1784045389) 00000100:00100000:1.0:1784045392.019664:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873859456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784045392.019737:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045392.019907:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873859456 00000100:00100000:0.0:1784045392.019916:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873859456 00000100:00100000:0.0:1784045392.020109:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784045392.020119:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873859456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045392.020150:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045392.020480:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873859456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 361us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045392.020488:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784045392.022502:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873859456:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784045392.854836:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045393.100056:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045393.100109:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045393.100167:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045393.100268:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863276160 00000100:00100000:3.0:1784045393.100281:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863276160 00000100:00100000:1.0:1784045393.100981:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045393.101016:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045393.101062:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863276416 00000100:00100000:1.0:1784045393.101068:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863276416 00000100:00100000:1.0:1784045393.101124:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863276288 00000100:00100000:1.0:1784045393.101138:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863276288 00000100:00100000:1.0:1784045393.101153:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863276544 00000100:00100000:1.0:1784045393.101155:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863276544 00000100:00100000:1.0:1784045393.101173:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 280 00000100:00100000:1.0:1784045393.101248:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863276416:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045393.101470:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863276416:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 287us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045393.101479:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 280 00000100:00100000:1.0:1784045393.101507:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 281 00000100:00100000:1.0:1784045393.101514:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863276288:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045393.101540:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863276288:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045393.101546:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 281 00000100:00100000:1.0:1784045393.101558:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 282 00000100:00100000:1.0:1784045393.101563:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863276544:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045393.101586:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863276544:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 23us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045393.101592:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 282 00000100:00080000:0.0:1784045393.103893:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784045393.103906:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045393.104222:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 283 00000100:00100000:3.0:1784045393.104235:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863276160:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045393.104345:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863276160:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 113us (4304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045393.104353:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 283 00000100:00080000:0.0:1784045393.105821:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045393.109029:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863276032 00000100:00100000:2.0:1784045393.109048:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863276032 00000100:00100000:2.0:1784045393.109139:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 379 00000100:00100000:2.0:1784045393.109152:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2397:x1870706863276032:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045393.109265:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2397:x1870706863276032:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 115us (9097us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045393.109273:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 379 00000100:00100000:0.0:1784045393.555902:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045393.555939:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873859584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045393.556035:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045393.556480:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873860096:0@lo:400:kworker.0 00000100:00100000:2.0:1784045393.556516:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045393.556546:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873860608:0@lo:400:kworker.0 00000100:00100000:2.0:1784045393.556571:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045393.556593:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873861120:0@lo:400:kworker.0 00000100:00100000:2.0:1784045393.556615:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045393.556641:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784045393.556647:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873859968:0@lo:400:kworker.0 00000100:00100000:2.0:1784045393.556674:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045393.556690:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873860480:0@lo:400:kworker.0 00000100:00100000:2.0:1784045393.556711:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045393.556729:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873860992:0@lo:400:kworker.0 00000100:00100000:2.0:1784045393.556748:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045393.556785:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873860608 00000100:00100000:2.0:1784045393.556795:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873860608 00000100:00100000:2.0:1784045393.556851:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873861120 00000100:00100000:2.0:1784045393.556855:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873861120 00000100:00100000:2.0:1784045393.556870:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873860480 00000100:00100000:2.0:1784045393.556872:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873860480 00000100:00100000:2.0:1784045393.556891:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873860992 00000100:00100000:2.0:1784045393.556904:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873860992 00000100:00100000:2.0:1784045393.556923:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784045393.556932:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873860608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045393.556991:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873860608:12345-0@lo:400:kworker.0 Request processed in 60us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045393.557338:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873859840:0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.557378:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045393.557403:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873860352:0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.557435:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045393.557481:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873860864:0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.557505:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045393.557526:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784045393.557532:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873859712:0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.557572:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045393.557601:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873860224:0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.557623:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045393.557635:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873860736:0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.557656:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045393.557681:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873859968 00000100:00100000:0.0:1784045393.557686:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873859968 00000100:00100000:0.0:1784045393.557715:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873859840 00000100:00100000:0.0:1784045393.557718:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873859840 00000100:00100000:0.0:1784045393.557730:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1784045393.557737:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873859968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.557777:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873859968:12345-0@lo:400:kworker.0 Request processed in 40us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045393.557785:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1784045393.557802:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873860352 00000100:00100000:0.0:1784045393.557805:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873860352 00000100:00100000:0.0:1784045393.557821:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873860864 00000100:00100000:0.0:1784045393.557824:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873860864 00000100:00100000:0.0:1784045393.557837:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873860224 00000100:00100000:0.0:1784045393.557840:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873860224 00000100:00100000:0.0:1784045393.557853:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873860736 00000100:00100000:0.0:1784045393.557856:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873860736 00000100:00100000:0.0:1784045393.557872:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1784045393.557877:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873859840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.557914:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873859840:12345-0@lo:400:kworker.0 Request processed in 36us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045393.557920:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1784045393.557931:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1784045393.557945:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873860352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.557972:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873860352:12345-0@lo:400:kworker.0 Request processed in 28us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045393.557977:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1784045393.557987:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1784045393.557992:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873860864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.558016:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873860864:12345-0@lo:400:kworker.0 Request processed in 24us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045393.558021:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1784045393.558031:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1784045393.558036:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873860224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.558059:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873860224:12345-0@lo:400:kworker.0 Request processed in 23us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045393.558064:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1784045393.558073:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1784045393.558079:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873860736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.558118:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873860736:12345-0@lo:400:kworker.0 Request processed in 39us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045393.558124:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1784045393.558146:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873859712 00000100:00100000:0.0:1784045393.558149:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873859712 00000100:00100000:0.0:1784045393.558178:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1784045393.558184:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873859712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.558230:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873859712:12345-0@lo:400:kworker.0 Request processed in 46us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045393.558245:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:0.0:1784045393.558276:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045393.558280:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784045393.558283:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045393.558286:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045393.558332:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873859712:0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.558348:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873860224:0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.558359:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873860736:0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.558368:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873859840:0@lo:400:kworker.0 00010000:00080000:0.0:1784045393.558381:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831fb800 x1870706873860352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045393.558392:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873860352:0@lo:400:kworker.0 00010000:00080000:0.0:1784045393.558401:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c83ca8e00 x1870706873860864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045393.558410:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873860864:0@lo:400:kworker.0 00000100:00100000:1.0:1784045393.558580:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873859584 00000100:00100000:1.0:1784045393.558585:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873859584 00000100:00100000:1.0:1784045393.558616:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873860096 00000100:00100000:1.0:1784045393.558619:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873860096 00000100:00100000:1.0:1784045393.558633:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784045393.558639:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873859584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045393.558682:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1784045393.558731:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873859584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (2697us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045393.558737:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784045393.558756:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784045393.558762:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873860096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045393.558789:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873860096:12345-0@lo:400:kworker.0 Request processed in 28us (2273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045393.558795:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784045393.558920:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784045393.558960:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784045393.558971:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873861120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.559009:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873861120:12345-0@lo:400:kworker.0 Request processed in 42us (2393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045393.559016:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784045393.559031:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1784045393.559037:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873860480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.559077:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873860480:12345-0@lo:400:kworker.0 Request processed in 39us (2363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045393.559092:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1784045393.559105:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784045393.559112:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873860992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.559142:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873860992:12345-0@lo:400:kworker.0 Request processed in 32us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045393.559147:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784045393.559214:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873859584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045393.559261:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873859968:0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.559274:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873860480:0@lo:400:kworker.0 00010000:00080000:0.0:1784045393.559287:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c83ca8380 x1870706873860992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045393.559297:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873860992:0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.559308:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873860096:0@lo:400:kworker.0 00000100:00100000:0.0:1784045393.559320:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873860608:0@lo:400:kworker.0 00010000:00080000:0.0:1784045393.559331:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c83cab800 x1870706873861120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045393.559340:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873861120:0@lo:400:kworker.0 00010000:00010000:1.0:1784045393.875749:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045394.035494:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045394.036670:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863276672 00000100:00100000:0.0:1784045394.036691:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863276672 00000100:00100000:0.0:1784045394.036766:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:0.0:1784045394.036800:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:11075:x1870706863276672:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045394.036820:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045394.041804:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c8ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eea0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.042381:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c8c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.042397:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.042414:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045394.043660:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784045394.043670:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784045394.043804:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.043846:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c8ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eea0 expref: 7 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.044657:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eea0 expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.044673:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c813ee500) 00010000:00010000:0.0:1784045394.044678:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784045394.044691:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915ab400, rc 0) 00000100:00100000:0.0:1784045394.044783:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:11075:x1870706863276672:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 7991us (9357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045394.044811:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:0.0:1784045394.062695:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045394.062869:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863276800 00000100:00100000:3.0:1784045394.062891:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863276800 00000100:00100000:3.0:1784045394.062950:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:3.0:1784045394.062960:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:11076:x1870706863276800:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045394.063228:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045394.063251:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c8c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eea7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045394.063340:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454c8cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045394.063354:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454c8cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045394.063365:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454c8cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045394.063437:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c8d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045394.063573:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045394.063583:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.063778:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987a00/0x5475624df454c8dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.063801:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987a00/0x5475624df454c8dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.063814:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987a00/0x5475624df454c8dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045394.063870:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784045394.063874:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045394.063912:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987a00/0x5475624df454c8dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.063926:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454c8cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.063932:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454c8cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.063958:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454c8cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.063964:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fc400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045394.063969:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454c8cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.063978:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454c8cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.063993:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c813ee500) 00010000:00010000:2.0:1784045394.064012:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045394.064019:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454c8cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.064026:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454c8cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.064049:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c8d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.064056:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c8d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.064061:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c8d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.064066:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fd600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045394.064069:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c8d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.064086:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c8d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.064095:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff939c93aa0e00) 00010000:00010000:2.0:1784045394.064098:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045394.064101:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c8d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.064106:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c8d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.064147:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c8c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eea7 expref: 8 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.064163:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987a00/0x5475624df454c8dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eea7 expref: 7 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.064171:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff939b83091400) 00010000:00010000:2.0:1784045394.064173:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045394.064175:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987a00, rc 0) 00000100:00100000:2.0:1784045394.064868:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:11076:x1870706863276800:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1905us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045394.064879:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:2.0:1784045394.069327:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045394.069381:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873861248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045394.069791:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045394.070008:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873861248 00000100:00100000:0.0:1784045394.070020:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873861248 00000100:00100000:0.0:1784045394.070090:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1784045394.070101:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873861248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045394.070153:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045394.070301:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873861248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 200us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045394.070311:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:2.0:1784045394.071090:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c88337b80 x1870706873861248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045394.071151:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873861248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045394.074859:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045394.074980:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863276928 00000100:00100000:3.0:1784045394.074992:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863276928 00000100:00100000:0.0:1784045394.074996:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873861376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045394.075076:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045394.075106:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:3.0:1784045394.075119:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:11076:x1870706863276928:12345-192.168.203.44@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1784045394.075390:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873861376 00000100:00100000:1.0:1784045394.075401:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873861376 00000100:00100000:3.0:1784045394.075428:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:11076:x1870706863276928:12345-192.168.203.44@tcp:900:lhsmtool_posix.0 Request processed in 301us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045394.075442:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:1.0:1784045394.075511:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1784045394.075524:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873861376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784045394.075547:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045394.075615:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873861376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045394.075621:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:2.0:1784045394.076234:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf546680 x1870706873861376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045394.076256:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873861376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045394.102092:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045394.102723:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863277184 00000100:00100000:0.0:1784045394.102737:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863277184 00000100:00100000:0.0:1784045394.102819:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:0.0:1784045394.102832:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:11076:x1870706863277184:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045394.102859:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045394.102902:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c8e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eeae expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103007:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c8eb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103027:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c8eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103041:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c8eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103207:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c8f2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103230:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103243:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103365:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c8f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103373:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103380:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c8f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045394.103390:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1784045394.103552:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c8eb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103559:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c8eb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103566:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c8eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103571:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aaa00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045394.103575:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c8eb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103598:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c8eb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103611:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff939b83091400) 00010000:00010000:0.0:1784045394.103614:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045394.103619:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c8eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103625:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c8eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103643:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103649:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c8f2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103654:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103659:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915abe00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045394.103662:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103667:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c8f2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103673:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff939c813eee00) 00010000:00010000:0.0:1784045394.103675:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045394.103677:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c8f2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045394.103691:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c8f2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.106148:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c8e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eeae expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.106357:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c8f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eeae expref: 9 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045394.106370:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c813ee300) 00010000:00010000:2.0:1784045394.106373:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045394.106377:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915ab200, rc 0) 00000100:00100000:2.0:1784045394.106497:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:11076:x1870706863277184:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 3666us (4418us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784045394.106508:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:0.0:1784045394.125902:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045394.129815:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863277312 00000100:00100000:3.0:1784045394.129830:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863277312 00000100:00100000:3.0:1784045394.129902:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:3.0:1784045394.129911:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:11076:x1870706863277312:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784045394.130032:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:11076:x1870706863277312:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 Request processed in 121us (4139us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045394.130039:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:1.0:1784045394.138386:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045394.138481:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863277440 00000100:00100000:3.0:1784045394.138490:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863277440 00000100:00100000:3.0:1784045394.138555:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:3.0:1784045394.138565:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:11076:x1870706863277440:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1784045394.148833:0:6498:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 10225us 00000100:00100000:0.0:1784045394.177292:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:11076:x1870706863277440:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 Request processed in 38719us (38905us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045394.177307:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 44 00000040:00080000:0.0:1784045394.388381:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1784045394.389384:0:13778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784045394.912639:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045395.933575:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045396.628818:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873861504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784045396.628897:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045396.631949:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045396.631973:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873861632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045396.632048:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045396.632115:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873861504 00000100:00100000:3.0:1784045396.632122:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873861504 00000100:00100000:3.0:1784045396.632472:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873861632 00000100:00100000:3.0:1784045396.632477:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873861632 00000100:00100000:3.0:1784045396.632498:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784045396.632506:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873861504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784045396.632533:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045396.632582:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873861504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (3685us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045396.632588:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784045396.632605:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1784045396.632611:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873861632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045396.632620:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045396.632644:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873861632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045396.632666:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1784045396.632684:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045396.632715:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873861632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045396.632730:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873861504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045396.648579:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045396.648847:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863277568 00000100:00100000:3.0:1784045396.648857:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863277568 00000100:00100000:3.0:1784045396.648930:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:3.0:1784045396.648940:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:11119:x1870706863277568:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045396.648959:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045396.648978:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454c907 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eeb5 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784045396.649362:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784045396.649423:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c90e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649437:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c90e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649480:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c90e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649497:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c915 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649506:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649513:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649564:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c90e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649571:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c90e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649578:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c90e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649584:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fd800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045396.649588:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c90e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649596:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c90e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649608:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c813ee500) 00010000:00010000:3.0:1784045396.649611:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045396.649615:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c90e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649622:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c90e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649634:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c915 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649640:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c915 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649646:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c915 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649655:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fd600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045396.649659:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c915 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649664:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c915 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649671:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff939c93a85b00) 00010000:00010000:3.0:1784045396.649673:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045396.649675:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c915 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649681:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c915 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649715:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454c907 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eeb5 expref: 10 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.649725:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c813ee500) 00010000:00010000:3.0:1784045396.649727:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045396.650238:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454c907 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eeb5 expref: 10 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.650251:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fda00, rc 0) 00000100:00100000:3.0:1784045396.650367:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:11119:x1870706863277568:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1428us (1797us total) trans 0 rc 301/301 00000100:00100000:3.0:1784045396.650375:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:1.0:1784045396.662558:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045396.662604:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863277824 00000100:00100000:2.0:1784045396.662612:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863277824 00000100:00100000:2.0:1784045396.662686:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:2.0:1784045396.662695:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:11119:x1870706863277824:12345-192.168.203.44@tcp:36:lfs.0 00010000:00010000:2.0:1784045396.662937:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045396.662984:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c8c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eea0 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.663003:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c813ee500) 00010000:00010000:2.0:1784045396.663020:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045396.663085:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454c91c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.663254:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454c91c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.663265:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454c91c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.663279:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454c923 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.663286:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454c923 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045396.663292:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454c923 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.669662:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c92a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.669693:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c92a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.669704:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c92a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045396.669723:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d416047b reply state 00000000e1531bf7 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c92a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.669733:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c92a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.669740:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:1.0:1784045396.669743:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784045396.669746:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784045396.669751:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1784045396.669759:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454c91c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.669765:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454c91c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.669772:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454c91c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.669778:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045396.669782:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454c91c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.669789:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454c91c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.669807:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939b82a43e00) 00010000:00010000:1.0:1784045396.669809:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045396.669813:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454c91c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.669820:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454c91c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045396.669836:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d416047b reply state 00000000e1531bf7 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454c923 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.669843:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454c923 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.669850:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff939b82a43900) 00010000:00010000:1.0:1784045396.669852:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784045396.669854:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1784045396.678035:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:11119:x1870706863277824:12345-192.168.203.44@tcp:36:lfs.0 Request processed in 15331us (15476us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1784045396.678050:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:1.0:1784045396.823506:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045396.823628:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863277952 00000100:00100000:3.0:1784045396.823647:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863277952 00000100:00100000:3.0:1784045396.824053:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:3.0:1784045396.824063:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:11127:x1870706863277952:12345-192.168.203.44@tcp:101:lctl.0 00010000:00010000:3.0:1784045396.824083:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045396.824106:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454c931 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eebc expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.824166:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c938 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.824180:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.824191:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045396.824237:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784045396.824241:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784045396.824275:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c938 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.824298:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454c931 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eebc expref: 12 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.824315:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c938 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eebc expref: 11 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.824324:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85b00) 00010000:00010000:3.0:1784045396.824328:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045396.824331:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fd600, rc 0) 00000100:00100000:3.0:1784045396.826481:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:11127:x1870706863277952:12345-192.168.203.44@tcp:101:lctl.0 Request processed in 2384us (2948us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045396.826493:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:2.0:1784045396.887316:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045396.887778:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863278080 00000100:00100000:1.0:1784045396.887787:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863278080 00000100:00100000:1.0:1784045396.887850:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 48 00000100:00100000:1.0:1784045396.887861:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:11133:x1870706863278080:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:1.0:1784045396.887880:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045396.887900:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c93f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eec3 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.887974:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c946 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.887990:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888017:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888030:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c94d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888038:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c94d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888045:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c94d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888123:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd800/0x5475624df454c954 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888131:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd800/0x5475624df454c954 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888151:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd800/0x5475624df454c954 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045396.888183:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784045396.888188:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784045396.888222:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd800/0x5475624df454c954 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888233:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c946 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888239:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c946 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888255:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c946 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888261:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cce00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045396.888264:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c946 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888271:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c946 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888282:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85b00) 00010000:00010000:1.0:1784045396.888286:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045396.888290:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c946 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888297:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c946 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888312:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c94d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888317:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c94d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888322:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c94d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888327:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045396.888330:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c94d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888347:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c94d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888356:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff939b82a43900) 00010000:00010000:1.0:1784045396.888358:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045396.888362:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c94d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888368:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c94d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888392:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c93f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eec3 expref: 13 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888416:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd800/0x5475624df454c954 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eec3 expref: 12 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.888423:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:1.0:1784045396.888425:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784045396.888428:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cd800, rc 0) 00000100:00100000:1.0:1784045396.888550:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+12:11133:x1870706863278080:12345-192.168.203.44@tcp:101:bash.0 Request processed in 691us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045396.888557:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 48 00000100:00100000:1.0:1784045396.904920:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045396.905075:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863278336 00000100:00100000:0.0:1784045396.905084:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863278336 00000100:00100000:0.0:1784045396.905144:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 49 00000100:00100000:0.0:1784045396.905154:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+12:11133:x1870706863278336:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1784045396.905174:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045396.905198:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c95b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eeca expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.905300:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c962 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.905315:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c962 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045396.905327:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c962 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.911757:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c969 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.911782:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c969 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.911811:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c969 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784045396.912170:0:10615:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1784045396.912315:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c970 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.912326:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c970 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.912333:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c970 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.912364:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c962 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.912370:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c962 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.912376:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c962 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.912382:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aae00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045396.912386:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c962 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.912392:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c962 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.912414:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:1.0:1784045396.912417:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045396.912428:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c962 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.912434:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454c962 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045396.912668:0:10615:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f34ae1a reply state 00000000e8c0f0ca transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c969 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.912681:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c969 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.912688:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939b81924700) 00010000:00010000:1.0:1784045396.912690:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784045396.912693:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784045396.912731:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454c95b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eeca expref: 15 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.912746:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c970 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eeca expref: 14 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.912753:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b81924100) 00010000:00010000:1.0:1784045396.912755:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045396.912757:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cc200, rc 0) 00000100:00100000:1.0:1784045396.912832:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:11133:x1870706863278336:12345-192.168.203.44@tcp:101:bash.0 Request processed in 7679us (7931us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1784045396.912841:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 49 00000100:00100000:3.0:1784045396.923433:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045396.923660:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863278464 00000100:00100000:0.0:1784045396.923681:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863278464 00000100:00100000:0.0:1784045396.923733:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:0.0:1784045396.923741:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1870706863278464:12345-192.168.203.44@tcp:8:bash.0 00010000:00080000:0.0:1784045396.923775:0:8411:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp t0 exp 0000000000000000 cur 353 last 0 00000020:00000080:0.0:1784045396.923803:0:8411:0:(genops.c:1406:class_connect()) connect: client bbcbf11d-b5f2-42a6-9759-7590eb85aa60, cookie 0x5475624df454c97e 00002000:00100000:0.0:1784045396.923816:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bbcbf11d-b5f2-42a6-9759-7590eb85aa60/ffff939b83394000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784045396.923834:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:0.0:1784045396.923905:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784045396.923945:0:8411:0:(import.c:65:import_set_state_nolock()) ffff939b83392800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045396.924017:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2393:x1870706863278464:12345-192.168.203.44@tcp:8:bash.0 Request processed in 275us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045396.924025:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:2.0:1784045396.927800:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045396.927926:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863278592 00000100:00100000:3.0:1784045396.927935:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863278592 00000100:00100000:3.0:1784045396.928003:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:3.0:1784045396.928012:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:0:x1870706863278592:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1784045396.928028:0:9935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045396.928049:0:9935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c25b9c1/0x5475624df454c985 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eed1 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784045396.928081:0:9935:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045396.928097:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=353s v=(0 0) 00010000:00010000:3.0:1784045396.928102:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045396.928112:0:9935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c25b9c1/0x5475624df454c985 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eed1 expref: 7 pid: 9935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.928130:0:9935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c25b9c1/0x5475624df454c985 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eed1 expref: 7 pid: 9935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.928143:0:9935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fda00, rc 0) 00000100:00100000:3.0:1784045396.928203:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:0:x1870706863278592:12345-192.168.203.44@tcp:101:bash.0 Request processed in 192us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045396.928210:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00080000:0.0:1784045396.929549:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784045396.934643:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045396.934754:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863278720 00000100:00100000:1.0:1784045396.934764:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863278720 00000100:00100000:1.0:1784045396.934834:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:1.0:1784045396.934844:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:11133:x1870706863278720:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:1.0:1784045396.934877:0:8648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045396.934898:0:8648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eed8 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.934942:0:8648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c25b9c1/0x5475624df454c985 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eed1 expref: 8 pid: 9935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.934952:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045396.934956:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045396.934962:0:8648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 8 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.934996:0:8648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c25b9c1/0x5475624df454c985 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed1 expref: 8 pid: 9935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.935011:0:8648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c25b9c1/0x5475624df454c985 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed1 expref: 8 pid: 9935 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045396.935024:0:8648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8648:1870706873861760:192.168.203.44@tcp:104: 00000100:00100000:1.0:1784045396.935124:0:8648:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c85155540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045396.937947:0:8648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8648:1870706873861760:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045396.937988:0:8648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 8 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045396.938008:0:8648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cce00, rc 0) 00000100:00100000:1.0:1784045396.938084:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:11133:x1870706863278720:12345-192.168.203.44@tcp:101:bash.0 Request processed in 3241us (3451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045396.938092:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:2.0:1784045396.945147:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045396.945417:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863278848 00000100:00100000:3.0:1784045396.945481:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863278848 00010000:00010000:3.0:1784045396.945525:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c25b9c1/0x5475624df454c985 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed1 expref: 8 pid: 9935 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045396.945575:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:3.0:1784045396.945586:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe48850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2395:x1870706863278848:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045396.945603:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045396.945625:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c25b9c1/0x5475624df454c985 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed1 expref: 8 pid: 9935 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.945641:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c25b9c1/0x5475624df454c985 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed1 expref: 8 pid: 9935 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.945665:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c25b9c1/0x5475624df454c985 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed1 expref: 8 pid: 9935 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.945682:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045396.945687:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045396.945694:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 7 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.945704:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 7 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045396.945742:0:6482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 7 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045396.945769:0:6482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf546680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6482:1870706873861888:192.168.203.44@tcp:105: 00000100:00100000:3.0:1784045396.945849:0:6482:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92dfca80 going to sleep for 11 seconds 00010000:00010000:1.0:1784045396.947683:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045396.952821:0:6482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf546680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6482:1870706873861888:192.168.203.44@tcp:105: 00010000:00010000:3.0:1784045396.952846:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045396.952919:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe48850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863278848:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 7333us (7781us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045396.952928:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:2.0:1784045396.954901:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045396.954996:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863279104 00000100:00100000:1.0:1784045396.955005:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863279104 00000100:00100000:1.0:1784045396.955069:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:1.0:1784045396.955079:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:11133:x1870706863279104:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:1.0:1784045396.955390:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:11133:x1870706863279104:12345-192.168.203.44@tcp:35:bash.0 Request processed in 312us (494us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1784045396.955398:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:2.0:1784045397.073233:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045397.073650:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863279360 00000100:00100000:1.0:1784045397.073671:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863279360 00000100:00100000:1.0:1784045397.073734:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:1.0:1784045397.073744:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:11143:x1870706863279360:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1784045397.073769:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045397.073790:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cde00/0x5475624df454c993 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eedf expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045397.073897:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1784045397.073998:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cde00/0x5475624df454c993 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eedf expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.074013:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85b00) 00010000:00010000:1.0:1784045397.074016:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045397.074020:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cde00/0x5475624df454c993 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eedf expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.074056:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cde00, rc 0) 00000100:00100000:1.0:1784045397.074116:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:11143:x1870706863279360:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 373us (892us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1784045397.074124:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:3.0:1784045397.082594:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045397.083351:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863279616 00000100:00100000:1.0:1784045397.083361:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863279616 00000100:00100000:1.0:1784045397.083431:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:1.0:1784045397.083442:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:11143:x1870706863279616:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:1.0:1784045397.083996:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:11143:x1870706863279616:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 554us (1409us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1784045397.084005:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:2.0:1784045397.148867:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045397.148900:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873862016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045397.148994:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045397.149936:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873862016 00000100:00100000:0.0:1784045397.149944:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873862016 00000100:00100000:0.0:1784045397.150006:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784045397.150017:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873862016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045397.150053:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1784045397.150127:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873862016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045397.150135:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784045397.150327:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873862016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045397.201879:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045397.201976:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863279744 00000100:00100000:3.0:1784045397.201985:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863279744 00000100:00100000:3.0:1784045397.202049:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:3.0:1784045397.202059:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:11149:x1870706863279744:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045397.202083:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045397.202103:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454c9a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eee6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.202188:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c9a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.202202:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.202214:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045397.202295:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784045397.202299:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784045397.202327:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.202353:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454c9a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eee6 expref: 20 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.202375:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eee6 expref: 19 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.202385:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:3.0:1784045397.202387:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045397.202391:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fd800, rc 0) 00000100:00100000:3.0:1784045397.202557:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:11149:x1870706863279744:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 499us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045397.202565:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:2.0:1784045397.216718:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045397.216816:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863280000 00000100:00100000:0.0:1784045397.216826:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863280000 00000100:00100000:0.0:1784045397.216890:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:0.0:1784045397.216916:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:11149:x1870706863280000:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1784045397.216937:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045397.216959:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c9af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eeed expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.217070:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c9b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.217085:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.217096:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045397.217109:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784045397.217235:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454c9af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eeed expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.217253:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eeed expref: 21 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.217263:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b81924100) 00010000:00010000:0.0:1784045397.217266:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045397.217270:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915abe00, rc 0) 00000100:00100000:0.0:1784045397.217356:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:11149:x1870706863280000:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 441us (648us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1784045397.217364:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:0.0:1784045397.222096:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045397.222155:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045397.222241:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863280384 00000100:00100000:1.0:1784045397.222251:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863280384 00000100:00100000:3.0:1784045397.222252:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863280256 00000100:00100000:3.0:1784045397.222259:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863280256 00000100:00100000:1.0:1784045397.222333:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:1.0:1784045397.222347:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:2397:x1870706863280384:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045397.222371:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784045397.222379:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:3.0:1784045397.222389:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11149:x1870706863280256:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1784045397.222397:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454c9b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eeed expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.222422:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045397.222429:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b81924100) 00010000:00010000:1.0:1784045397.222436:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045397.222441:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454c9c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eef4 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045397.222514:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:2397:x1870706863280384:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 171us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045397.222522:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3 00010000:00010000:3.0:1784045397.222573:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454c9cb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.222598:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454c9cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.222609:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454c9cb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045397.222622:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1784045397.222740:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454c9c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eef4 expref: 23 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.222757:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454c9cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eef4 expref: 22 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.222764:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b81924100) 00010000:00010000:3.0:1784045397.222832:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784045397.222836:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fda00, rc 0) 00000100:00100000:3.0:1784045397.222881:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11149:x1870706863280256:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 494us (726us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1784045397.222888:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:0.0:1784045397.235891:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045397.236040:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863280512 00000100:00100000:1.0:1784045397.236050:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863280512 00000100:00100000:1.0:1784045397.236122:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:1.0:1784045397.236133:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863280512:12345-192.168.203.44@tcp:1:lfs.0 00010000:00010000:1.0:1784045397.236185:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.236206:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 7 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.236215:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045397.236220:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045397.236225:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.236259:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 7 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.236274:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 7 pid: 8648 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045397.236288:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1870706873862144:192.168.203.44@tcp:104: 00000100:00100000:1.0:1784045397.236383:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c85155540 going to sleep for 11 seconds 00000100:00100000:0.0:1784045397.248320:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045397.248575:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1870706873862144:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045397.248606:0:8413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045397.248764:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863280640 00000100:00100000:2.0:1784045397.248772:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863280640 00002000:00100000:2.0:1784045397.248814:0:8417:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff939b831f8e00 x1870706863280640/t0(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:38/0 lens 504/0 e 0 to 0 dl 1784045408 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045397.248825:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b831f8e00 with x1870706863280640 ext(0->12) 00010000:00010000:2.0:1784045397.248831:0:8417:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 8 pid: 8648 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.248844:0:8417:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 8 pid: 8648 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045397.248856:0:8417:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939b831f8e00 00000100:00100000:2.0:1784045397.248892:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:2.0:1784045397.248901:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2395:x1870706863280640:12345-192.168.203.44@tcp:4:lfs.0 00000001:00100000:3.0:1784045397.253939:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000100:00100000:2.0:1784045397.257931:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2395:x1870706863280640:12345-192.168.203.44@tcp:4:lfs.0 Request processed in 9014us (9609us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784045397.257951:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00002000:00100000:2.0:1784045397.257967:0:8417:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff939b831f8e00 x1870706863280640/t4294967300(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:38/0 lens 504/448 e 0 to 0 dl 1784045408 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045397.257980:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b831f8e00 with x1870706863280640 ext(0->12) 00010000:00010000:2.0:1784045397.257993:0:8417:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 9 pid: 8648 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.258039:0:8417:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 9 pid: 8648 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045397.258049:0:8417:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939b831f8e00 00000100:00100000:2.0:1784045397.276800:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045397.276897:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863280768 00000100:00100000:1.0:1784045397.276910:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863280768 00010000:00010000:1.0:1784045397.276959:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 9 pid: 8648 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045397.277004:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:1.0:1784045397.277015:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2397:x1870706863280768:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045397.277033:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784045397.277054:0:9500:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784045397.277057:0:9500:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1784045396 00002000:00010000:1.0:1784045397.277059:0:9500:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1784045396 00002000:00010000:1.0:1784045397.277062:0:9500:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1784045396 00002000:00010000:1.0:1784045397.277064:0:9500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784045397.277071:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 9 pid: 8648 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.277086:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 9 pid: 8648 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.277119:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454c98c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73eed8 expref: 9 pid: 8648 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.277139:0:9500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045397.277144:0:9500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045397.277152:0:9500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.277176:0:9500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.277217:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045397.277295:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2397:x1870706863280768:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 281us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045397.277303:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 53 00010000:00010000:0.0:1784045397.277830:0:8413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.277844:0:8413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.277871:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.277880:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.277889:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.277898:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cdc00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:0.0:1784045397.277902:0:8413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.277911:0:8413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.277926:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045397.277949:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001373a03e/0x5475624df454c9d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045397.278039:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863280512:12345-192.168.203.44@tcp:1:lfs.0 Request processed in 41907us (42155us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045397.278048:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:2.0:1784045397.282748:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045397.282879:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863281024 00000100:00100000:1.0:1784045397.282892:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863281024 00000100:00100000:1.0:1784045397.282956:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:1.0:1784045397.282967:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11149:x1870706863281024:12345-192.168.203.44@tcp:35:lfs.0 00000004:00010000:1.0:1784045397.283042:0:6499:0:(mdt_open.c:1993:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454c9cb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eef4 expref: 22 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784045397.283313:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1784045397.283362:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1784045397.283808:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1784045397.283850:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.283868:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c970 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eeca expref: 26 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.283879:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.283920:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c970 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73eeca expref: 26 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045397.283944:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c970 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73eeca expref: 26 pid: 10615 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045397.283960:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1870706873862272:192.168.203.44@tcp:104: 00000100:00100000:1.0:1784045397.284073:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c91584f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784045397.289646:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045397.291080:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca4700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1870706873862272:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045397.291117:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045397.295241:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863281152 00000100:00100000:3.0:1784045397.295271:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863281152 00010000:00010000:3.0:1784045397.295335:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c970 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73eeca expref: 27 pid: 10615 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045397.295426:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:3.0:1784045397.295471:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:2395:x1870706863281152:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045397.295509:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045397.295517:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c970 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73eeca expref: 27 pid: 10615 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.295532:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c970 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73eeca expref: 27 pid: 10615 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.295559:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454c970 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73eeca expref: 27 pid: 10615 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.295577:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b81924100) 00010000:00010000:3.0:1784045397.295583:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.295593:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.295602:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045397.295645:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045397.295721:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+26:2395:x1870706863281152:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 285us (6089us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045397.295730:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 54 00010000:00010000:2.0:1784045397.295795:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.295804:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045397.295954:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1784045397.296764:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1784045397.296890:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1870706873862400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784045397.296961:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045397.296998:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784045397.297511:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873862400 00000100:00100000:1.0:1784045397.297524:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873862400 00000100:00100000:1.0:1784045397.297628:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784045397.297644:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1870706873862400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784045397.297810:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1870706873862400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 170us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045397.297820:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:2.0:1784045397.298412:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784045397.298493:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1870706873862400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784045397.298765:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1784045397.298869:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1870706873862528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784045397.298935:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045397.298988:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784045397.300683:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873862528 00000100:00100000:1.0:1784045397.300700:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873862528 00000100:00100000:1.0:1784045397.300772:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784045397.300782:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6499:x1870706873862528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784045397.300996:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6499:x1870706873862528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 215us (2060us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1784045397.301004:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784045397.301194:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812af100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1870706873862528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784045397.301284:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1784045397.301336:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.301348:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.301356:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.301363:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cce00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045397.301369:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.301377:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.301396:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b81924100) 00010000:00010000:2.0:1784045397.301411:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784045397.301416:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.301424:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454c9e0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784045397.301577:0:6499:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784045397.301649:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1784045397.301672:0:6499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353410226329ns, next at 354410223602ns, rc = 0 00000001:00080000:2.0:1784045397.301678:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1784045397.301715:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b81924100) 00010000:00010000:2.0:1784045397.301718:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784045397.301726:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454c9cb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eef4 expref: 30 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045397.301851:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:11149:x1870706863281024:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 18884us (19117us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1784045397.301860:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 8 00000020:00080000:2.0:1784045397.301865:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1784045397.308848:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045397.309001:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863281280 00000100:00100000:2.0:1784045397.309013:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863281280 00000100:00100000:2.0:1784045397.309092:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:2.0:1784045397.309103:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:11149:x1870706863281280:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045397.309133:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045397.309162:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454c9e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eefb expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.309229:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454c9e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eefb expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.309245:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454c9e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eefb expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.309279:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045397.309282:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045397.309287:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986200, rc 0) 00000100:00100000:2.0:1784045397.309362:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:11149:x1870706863281280:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 261us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045397.309388:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:1.0:1784045397.322167:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045397.322240:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863281536 00000100:00100000:2.0:1784045397.322262:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863281536 00000100:00100000:2.0:1784045397.322332:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:2.0:1784045397.322343:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9855e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:11149:x1870706863281536:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:2.0:1784045397.322654:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9855e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+31:11149:x1870706863281536:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 312us (499us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1784045397.323296:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:3.0:1784045397.492502:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045397.492633:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863281792 00000100:00100000:2.0:1784045397.492645:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863281792 00000100:00100000:2.0:1784045397.492722:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:2.0:1784045397.492733:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+31:11159:x1870706863281792:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045397.492763:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045397.492787:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c9ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef02 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045397.492910:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1784045397.493031:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c9ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef02 expref: 33 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.493048:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85b00) 00010000:00010000:2.0:1784045397.493051:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045397.493068:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c9ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef02 expref: 33 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.493092:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986a00, rc 0) 00000100:00100000:2.0:1784045397.493177:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+32:11159:x1870706863281792:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 444us (689us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1784045397.493184:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:1.0:1784045397.499949:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045397.500194:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863281920 00000100:00100000:2.0:1784045397.500206:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863281920 00000100:00100000:2.0:1784045397.500289:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:2.0:1784045397.500300:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+32:11159:x1870706863281920:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:2.0:1784045397.500393:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c9fc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500424:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c9fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500438:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c9fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500476:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500484:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500490:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500584:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500593:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500600:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045397.500682:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500696:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c9fc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500704:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c9fc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500711:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c9fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500717:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045397.500722:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c9fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500730:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c9fc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500743:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:2.0:1784045397.500746:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045397.500752:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c9fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500759:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454c9fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500773:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500779:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500791:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500797:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045397.500799:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500805:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500813:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939b81924700) 00010000:00010000:2.0:1784045397.500815:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045397.500818:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500824:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500834:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500840:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500846:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500851:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045397.500854:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500868:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500875:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045397.500877:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045397.500880:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca0a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.500886:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045397.500973:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+32:11159:x1870706863281920:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 674us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045397.500982:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:1.0:1784045397.505820:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045397.505912:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863282176 00000100:00100000:0.0:1784045397.505924:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863282176 00000100:00100000:0.0:1784045397.505983:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:0.0:1784045397.505994:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+32:11159:x1870706863282176:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1784045397.506285:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+33:11159:x1870706863282176:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 292us (477us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1784045397.506294:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:3.0:1784045397.608774:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045397.608894:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863282432 00000100:00100000:2.0:1784045397.608907:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863282432 00000100:00100000:2.0:1784045397.608975:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:2.0:1784045397.608994:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+33:11162:x1870706863282432:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045397.609024:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045397.609049:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef09 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609138:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca18 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609155:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609168:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609194:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609201:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609208:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609335:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454ca26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609344:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454ca26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609351:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454ca26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045397.609363:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784045397.609519:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609528:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca18 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609535:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609542:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045397.609546:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609564:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca18 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609579:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:2.0:1784045397.609582:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045397.609587:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609604:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609619:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609625:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609631:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609636:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045397.609639:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609644:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609650:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939b81924700) 00010000:00010000:2.0:1784045397.609653:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045397.609655:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609670:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609709:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef09 expref: 36 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609723:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454ca26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef09 expref: 35 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.609731:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045397.609733:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045397.609735:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986e00, rc 0) 00000100:00100000:2.0:1784045397.609811:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+35:11162:x1870706863282432:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 826us (1052us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1784045397.609819:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:1.0:1784045397.615890:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045397.615978:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863282560 00000100:00100000:2.0:1784045397.615990:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863282560 00000100:00100000:2.0:1784045397.616083:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:2.0:1784045397.616096:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+35:11162:x1870706863282560:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:2.0:1784045397.616182:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.616202:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.616214:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.616282:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.616289:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.616298:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.616304:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045397.616309:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.616318:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.616333:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045397.616336:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045397.616342:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.616348:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045397.616480:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+35:11162:x1870706863282560:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 350us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045397.616490:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:1.0:1784045397.624270:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045397.630512:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863282816 00000100:00100000:0.0:1784045397.630533:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863282816 00000100:00100000:0.0:1784045397.630613:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:0.0:1784045397.630626:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+35:11162:x1870706863282816:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1784045397.630955:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+36:11162:x1870706863282816:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 331us (6699us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1784045397.630964:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00010000:00010000:1.0:1784045397.983703:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045397.984831:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045397.985820:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863283072 00000100:00100000:2.0:1784045397.985894:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863283072 00000100:00100000:2.0:1784045397.986183:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:2.0:1784045397.986219:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+36:11193:x1870706863283072:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:2.0:1784045397.986257:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045397.986285:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef10 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.986434:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.986471:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.986484:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045397.986497:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784045397.986662:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef10 expref: 39 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.986683:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef10 expref: 38 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045397.986693:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045397.986696:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045397.986701:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986a00, rc 0) 00000100:00100000:2.0:1784045397.986785:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:11193:x1870706863283072:12345-192.168.203.44@tcp:101:cat.0 Request processed in 569us (1962us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1784045397.986793:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:1.0:1784045397.999555:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045397.999594:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045397.999705:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863283328 00000100:00100000:0.0:1784045397.999717:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863283328 00000100:00100000:0.0:1784045397.999791:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:0.0:1784045397.999819:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:11193:x1870706863283328:12345-192.168.203.44@tcp:35:cat.0 00000100:00100000:3.0:1784045398.000820:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863283456 00000100:00100000:3.0:1784045398.000830:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863283456 00000100:00100000:3.0:1784045398.000917:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:3.0:1784045398.000926:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+40:2395:x1870706863283456:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045398.000940:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045398.000970:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef10 expref: 40 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045398.000990:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:3.0:1784045398.000997:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045398.001074:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+39:2395:x1870706863283456:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 149us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045398.001082:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:0.0:1784045398.001489:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+39:11193:x1870706863283328:12345-192.168.203.44@tcp:35:cat.0 Request processed in 1672us (1948us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1784045398.001498:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00080000:3.0:1784045398.003100:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045398.123852:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045398.123931:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863283712 00000100:00100000:2.0:1784045398.123944:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863283712 00000100:00100000:2.0:1784045398.124044:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:2.0:1784045398.124056:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:11199:x1870706863283712:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:2.0:1784045398.124086:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045398.124090:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784045398.124123:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454c9a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eee6 expref: 38 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.124147:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:2.0:1784045398.124153:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045398.124169:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca50 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef17 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.124309:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.124332:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454ca26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef09 expref: 38 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.124341:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.124379:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454ca26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef09 expref: 38 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.124532:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454ca26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef09 expref: 38 pid: 10615 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045398.124552:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1870706873862656:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045398.124680:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045398.140923:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1870706873862656:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045398.140964:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045398.145677:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045398.147310:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863283840 00000100:00100000:0.0:1784045398.147329:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863283840 00010000:00010000:0.0:1784045398.147403:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454ca26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef09 expref: 39 pid: 10615 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045398.147485:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:0.0:1784045398.147495:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+39:2394:x1870706863283840:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045398.147513:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045398.147520:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454ca26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef09 expref: 39 pid: 10615 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045398.147534:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454ca26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef09 expref: 39 pid: 10615 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045398.147559:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454ca26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef09 expref: 39 pid: 10615 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045398.147580:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:0.0:1784045398.147585:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045398.147595:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045398.147624:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045398.147675:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045398.147759:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:2394:x1870706863283840:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 264us (2094us total) trans 0 rc 0/0 00010000:00010000:2.0:1784045398.147791:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.147802:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045398.147829:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00000100:00100000:0.0:1784045398.147933:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 55 00010000:00010000:2.0:1784045398.148689:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca50 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef17 expref: 39 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.148712:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef17 expref: 38 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.148720:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045398.148723:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784045398.148726:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986c00, rc 0) 00000100:00100000:2.0:1784045398.148784:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:11199:x1870706863283712:12345-192.168.203.44@tcp:101:dd.0 Request processed in 24731us (24947us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1784045398.148792:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:1.0:1784045398.177670:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045398.177760:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863283968 00000100:00100000:3.0:1784045398.177772:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863283968 00000100:00100000:3.0:1784045398.177946:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:3.0:1784045398.177958:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:11199:x1870706863283968:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:3.0:1784045398.177987:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045398.178013:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454ca65 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef1e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045398.178055:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ca6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045398.178074:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ca6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045398.178088:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ca6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045398.178241:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454ca65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef1e expref: 40 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045398.178277:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ca6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef1e expref: 39 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045398.178287:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:3.0:1784045398.178291:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784045398.178294:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fd800, rc 0) 00000100:00100000:3.0:1784045398.178376:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+39:11199:x1870706863283968:12345-192.168.203.44@tcp:101:dd.0 Request processed in 421us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045398.178384:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:0.0:1784045398.182194:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045398.183356:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863284224 00000100:00100000:2.0:1784045398.183371:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863284224 00000100:00100000:2.0:1784045398.183489:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:2.0:1784045398.183500:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+39:11199:x1870706863284224:12345-192.168.203.44@tcp:36:dd.0 00010000:00010000:2.0:1784045398.185059:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca73 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.185089:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.185103:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045398.185159:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1784045398.185187:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c8cab8a reply state 000000009581f8d4 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.185202:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.185210:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045398.185213:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784045398.185217:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784045398.185577:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+42:11199:x1870706863284224:12345-192.168.203.44@tcp:36:dd.0 Request processed in 2073us (3391us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1784045398.185586:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 62 00000020:00080000:2.0:1784045398.185593:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784045398.212624:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045398.212680:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045398.212716:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045398.212744:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045398.212783:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045398.213082:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863284864 00000100:00100000:0.0:1784045398.213094:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863284864 00000100:00100000:0.0:1784045398.213175:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863284480 00000100:00100000:0.0:1784045398.213179:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863284480 00000100:00100000:0.0:1784045398.213194:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863284736 00000100:00100000:0.0:1784045398.213196:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863284736 00000100:00100000:0.0:1784045398.213214:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 290 00000100:00100000:0.0:1784045398.213224:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863284864:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045398.213323:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863284864:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 100us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045398.213331:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 290 00000100:00100000:0.0:1784045398.213348:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 291 00000100:00100000:0.0:1784045398.213354:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863284480:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045398.213377:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863284480:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045398.213384:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 291 00000100:00100000:0.0:1784045398.213405:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 292 00000100:00100000:0.0:1784045398.213412:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863284736:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045398.213481:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863284736:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 69us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045398.213488:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 292 00000100:00100000:0.0:1784045398.214498:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863284352 00000100:00100000:0.0:1784045398.214508:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863284352 00000100:00100000:0.0:1784045398.214551:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 381 00000100:00100000:0.0:1784045398.214559:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863284352:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045398.214609:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863284352:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 51us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045398.214616:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 381 00000100:00080000:1.0:1784045398.214932:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045398.214938:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045398.215090:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863284608 00000100:00100000:2.0:1784045398.215096:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863284608 00000100:00100000:2.0:1784045398.215149:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 139 00000100:00100000:2.0:1784045398.215157:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863284608:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045398.215193:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863284608:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 38us (2512us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045398.215199:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 139 00000100:00080000:1.0:1784045398.215318:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1784045398.488266:0:13778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1784045398.489031:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784045398.675842:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873862784:0@lo:400:kworker.0 00000100:00100000:0.0:1784045398.675941:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045398.676030:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873862784 00000100:00100000:0.0:1784045398.676039:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873862784 00000100:00100000:0.0:1784045398.676376:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1784045398.676387:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873862784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.676909:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045398.677066:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873863296:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677107:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045398.677129:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873863808:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677149:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045398.677162:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873864320:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677180:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045398.677199:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784045398.677204:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873863168:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677223:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045398.677238:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873863680:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677255:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045398.677269:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873864192:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677314:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045398.677344:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873863808 00000100:00100000:2.0:1784045398.677350:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873863808 00000100:00100000:2.0:1784045398.677407:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873864320 00000100:00100000:2.0:1784045398.677410:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873864320 00000100:00100000:2.0:1784045398.677424:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873863680 00000100:00100000:2.0:1784045398.677426:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873863680 00000100:00100000:2.0:1784045398.677437:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873864192 00000100:00100000:2.0:1784045398.677439:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873864192 00000100:00100000:2.0:1784045398.677475:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784045398.677481:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873863808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677537:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873863808:12345-0@lo:400:kworker.0 Request processed in 56us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045398.677555:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784045398.677572:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784045398.677577:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873864320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677602:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873864320:12345-0@lo:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045398.677607:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784045398.677616:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784045398.677622:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873863680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677642:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873863680:12345-0@lo:400:kworker.0 Request processed in 21us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045398.677648:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784045398.677671:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784045398.677677:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873864192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677699:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873864192:12345-0@lo:400:kworker.0 Request processed in 22us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045398.677704:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784045398.677747:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873863680:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677758:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873864192:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677766:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873863808:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677775:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873864320:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677820:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863284992 00000100:00100000:2.0:1784045398.677824:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863284992 00000100:00100000:2.0:1784045398.677851:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873863168 00000100:00100000:2.0:1784045398.677859:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873863168 00000100:00100000:2.0:1784045398.677879:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1784045398.677884:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873863168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.677916:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873863168:12345-0@lo:400:kworker.0 Request processed in 31us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045398.677921:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1784045398.677934:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:2.0:1784045398.677940:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+42:11213:x1870706863284992:12345-192.168.203.44@tcp:101:stat.0 00010000:00010000:2.0:1784045398.677957:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045398.677981:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454ca7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef25 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.678053:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca81 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.678069:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.678081:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.678092:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454ca88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.678100:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454ca88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.678107:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454ca88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.678198:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ca8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.678208:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef17 expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.678218:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ca8f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.678247:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef17 expref: 43 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.678261:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef17 expref: 43 pid: 6498 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045398.678273:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf550e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873864448:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045398.678341:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8546f240 going to sleep for 11 seconds 00000100:00100000:2.0:1784045398.678365:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873863168:0@lo:400:kworker.0 00000100:00100000:0.0:1784045398.678771:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873862784:12345-0@lo:400:kworker.0 Request processed in 2384us (2829us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045398.678780:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1784045398.678929:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873863040:0@lo:400:kworker.0 00000100:00100000:1.0:1784045398.678964:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045398.678995:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873863552:0@lo:400:kworker.0 00000100:00100000:1.0:1784045398.679017:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045398.679035:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873864064:0@lo:400:kworker.0 00000100:00100000:1.0:1784045398.679054:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045398.679069:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1784045398.679075:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873862912:0@lo:400:kworker.0 00000100:00100000:1.0:1784045398.679094:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045398.679104:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873863424:0@lo:400:kworker.0 00000100:00100000:1.0:1784045398.679120:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045398.679129:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873863936:0@lo:400:kworker.0 00000100:00100000:1.0:1784045398.679157:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045398.679166:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c921f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873864576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045398.679182:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784045398.679205:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045398.679211:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045398.679222:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873863296 00000100:00100000:1.0:1784045398.679227:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873863296 00000100:00100000:1.0:1784045398.679253:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873863040 00000100:00100000:1.0:1784045398.679255:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873863040 00000100:00100000:1.0:1784045398.679264:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873864576 00000100:00100000:1.0:1784045398.679265:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873864576 00000100:00100000:1.0:1784045398.679277:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784045398.679284:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873863296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045398.679336:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873863296:12345-0@lo:400:kworker.0 Request processed in 51us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045398.679343:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784045398.679361:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784045398.679367:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3626:x1870706873863040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045398.679783:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3626:x1870706873863040:12345-0@lo:400:kworker.0 Request processed in 414us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045398.679790:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784045398.679805:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784045398.679812:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873864576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045398.679840:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1784045398.679878:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873864576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045398.679884:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784045398.679962:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c921f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873864576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045398.679972:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873863040:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.681680:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873863296:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.681704:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873862784:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.681789:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873863552 00000100:00100000:2.0:1784045398.681798:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873863552 00000100:00100000:2.0:1784045398.681870:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873864064 00000100:00100000:2.0:1784045398.681874:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873864064 00000100:00100000:2.0:1784045398.681888:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873862912 00000100:00100000:2.0:1784045398.681891:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873862912 00000100:00100000:2.0:1784045398.681931:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873863424 00000100:00100000:2.0:1784045398.681934:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873863424 00000100:00100000:2.0:1784045398.681951:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873863936 00000100:00100000:2.0:1784045398.681954:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873863936 00000100:00100000:2.0:1784045398.681974:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1784045398.681983:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873863552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.682089:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873863552:12345-0@lo:400:kworker.0 Request processed in 106us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045398.682097:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1784045398.682116:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1784045398.682122:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873864064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.682154:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873864064:12345-0@lo:400:kworker.0 Request processed in 33us (3099us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045398.682161:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1784045398.682172:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1784045398.682177:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873862912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.682227:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873862912:12345-0@lo:400:kworker.0 Request processed in 49us (3131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045398.682234:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1784045398.682249:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1784045398.682256:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873863424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.682285:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873863424:12345-0@lo:400:kworker.0 Request processed in 29us (3162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045398.682291:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1784045398.682302:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1784045398.682308:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873863936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.682345:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873863936:12345-0@lo:400:kworker.0 Request processed in 37us (3187us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045398.682350:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1784045398.682387:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873862912:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.682413:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873863424:0@lo:400:kworker.0 00000100:00100000:2.0:1784045398.682425:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873863936:0@lo:400:kworker.0 00010000:00080000:2.0:1784045398.682441:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c812ac700 x1870706873863552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045398.682486:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873863552:0@lo:400:kworker.0 00010000:00080000:2.0:1784045398.682501:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c812ad880 x1870706873864064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045398.682511:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873864064:0@lo:400:kworker.0 00000100:00080000:0.0:1784045398.682672:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045398.682677:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045398.686679:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf550e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873864448:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045398.686723:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ca8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045398.691936:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045398.692322:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863285248 00000100:00100000:0.0:1784045398.692336:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863285248 00000100:00100000:0.0:1784045398.692419:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:0.0:1784045398.692431:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+44:6163:x1870706863285248:12345-192.168.203.44@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784045398.693520:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+45:6163:x1870706863285248:12345-192.168.203.44@tcp:35:ldlm_bl.0 Request processed in 1085us (1592us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1784045398.693531:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:1.0:1784045398.698564:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045398.698664:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863285376 00000100:00100000:0.0:1784045398.698675:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863285376 00010000:00010000:0.0:1784045398.698725:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef17 expref: 45 pid: 6498 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045398.698801:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:0.0:1784045398.698811:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+45:2394:x1870706863285376:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045398.698827:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045398.698834:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef17 expref: 45 pid: 6498 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045398.698846:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef17 expref: 45 pid: 6498 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045398.698870:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454ca57 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef17 expref: 45 pid: 6498 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045398.698886:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:0.0:1784045398.698892:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ca8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045398.698904:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ca8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045398.698914:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ca8f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045398.698971:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045398.699021:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ca8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699033:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ca8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045398.699057:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+44:2394:x1870706863285376:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 245us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045398.699067:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 56 00000004:00200000:2.0:1784045398.699113:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1784045398.699125:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045398.699180:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ca8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699294:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ca8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699305:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699310:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca81 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699315:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699368:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045398.699372:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699378:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699387:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:2.0:1784045398.699389:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045398.699404:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699410:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454ca81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699419:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454ca88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699432:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454ca88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699437:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454ca88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699439:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045398.699441:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454ca88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699484:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454ca88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699490:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939b81924700) 00010000:00010000:2.0:1784045398.699492:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045398.699494:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454ca88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699498:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454ca88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699531:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454ca7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef25 expref: 44 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699545:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ca8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef25 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.699553:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045398.699555:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045398.699563:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171000, rc 0) 00000100:00100000:2.0:1784045398.699603:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+43:11213:x1870706863284992:12345-192.168.203.44@tcp:101:stat.0 Request processed in 21661us (22696us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045398.699611:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:1.0:1784045398.773398:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045398.773581:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863285632 00000100:00100000:2.0:1784045398.773595:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863285632 00000100:00100000:2.0:1784045398.773691:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:2.0:1784045398.773703:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+43:11219:x1870706863285632:12345-192.168.203.44@tcp:36:truncate.0 00010000:00010000:2.0:1784045398.773785:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045398.773822:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ca8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef25 expref: 43 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.773845:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045398.773850:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045398.774091:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ca96 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.774110:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ca96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.774122:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ca96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045398.774178:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1784045398.774204:0:6498:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003277d784 reply state 00000000f8a060e9 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ca96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.774224:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ca96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045398.774264:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045398.774266:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784045398.774270:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784045398.774425:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+45:11219:x1870706863285632:12345-192.168.203.44@tcp:36:truncate.0 Request processed in 723us (1050us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1784045398.774434:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 64 00000020:00080000:2.0:1784045398.774440:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784045398.998557:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045399.013436:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045399.013678:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863285760 00000100:00100000:3.0:1784045399.013693:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863285760 00000100:00100000:3.0:1784045399.013780:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 65 00000100:00100000:3.0:1784045399.013793:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+45:11233:x1870706863285760:12345-192.168.203.44@tcp:101:stat.0 00010000:00010000:3.0:1784045399.013823:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045399.013852:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454ca9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef2c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014061:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454caa4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014079:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454caa4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014115:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454caa4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014132:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454caab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014140:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454caab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014147:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454caab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014245:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cab2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014254:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014442:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045399.014587:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1784045399.014593:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784045399.014625:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014639:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cab2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014648:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454caa4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014667:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454caa4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014674:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454caa4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014682:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fda00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045399.014687:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454caa4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014696:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454caa4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014710:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:3.0:1784045399.014714:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045399.014719:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454caa4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014725:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454caa4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014743:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454caab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014761:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454caab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014766:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454caab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014772:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106ea00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045399.014782:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454caab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014789:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454caab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014802:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939b81924700) 00010000:00010000:3.0:1784045399.014805:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045399.014808:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454caab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014813:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454caab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014851:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454ca9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef2c expref: 47 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014870:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cab2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef2c expref: 46 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.014878:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:3.0:1784045399.014881:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045399.014883:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106e600, rc 0) 00000100:00100000:3.0:1784045399.014975:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+46:11233:x1870706863285760:12345-192.168.203.44@tcp:101:stat.0 Request processed in 1184us (1636us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045399.014984:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 65 00000100:00100000:1.0:1784045399.148296:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045399.148583:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863286016 00000100:00100000:2.0:1784045399.148596:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863286016 00000100:00100000:2.0:1784045399.148687:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:2.0:1784045399.148699:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+46:11243:x1870706863286016:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045399.148728:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045399.148754:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cab9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef33 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045399.152959:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1784045399.154893:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cab9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef33 expref: 48 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.154920:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85b00) 00010000:00010000:2.0:1784045399.154923:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045399.154930:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cab9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef33 expref: 48 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.154947:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171000, rc 0) 00000100:00100000:2.0:1784045399.155037:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+47:11243:x1870706863286016:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 6339us (6754us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1784045399.155069:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 66 00000001:00080000:3.0:1784045399.163063:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000004:00080000:3.0:1784045399.163109:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1784045399.163238:0:6475:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939b83700d80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1784045399.163243:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939c87efc300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff939b837003c0 00000020:00080000:3.0:1784045399.163264:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939c87efc800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939c87fcc400 00000020:00080000:0.0:1784045399.163344:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1784045399.163653:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1784045399.165438:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045399.165500:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c921f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873864704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784045399.165603:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045399.165724:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873864704 00000100:00100000:0.0:1784045399.165735:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873864704 00000100:00100000:0.0:1784045399.165811:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784045399.165823:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1870706873864704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784045399.165858:0:8412:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1784045399.166181:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a565f54, atime: 0x6a565f54, ctime: 0x6a565f54, blocks: 0x8 00010000:00010000:0.0:1784045399.166194:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fcd4405/0x5475624df454cac7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.166217:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1784045399.166223:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045399.166232:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fcd4405/0x5475624df454cac7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.166300:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fcd4405/0x5475624df454cac7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.166334:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fcd4405/0x5475624df454cac7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.166342:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fcd4405/0x5475624df454cac7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.166373:0:8412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045399.166492:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454c923 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166510:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454c923 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166518:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454c923 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166525:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045399.166531:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454c923 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166539:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454c923 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166556:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff939b82a43900) 00010000:00010000:2.0:1784045399.166560:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045399.166566:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454c923 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166572:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454c923 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166595:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c92a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166602:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c92a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166625:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c92a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166630:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045399.166634:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c92a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166641:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c92a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166791:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:2.0:1784045399.166794:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045399.166798:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c92a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166804:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454c92a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166823:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c969 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166829:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c969 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166834:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c969 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166839:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cca00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045399.166842:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c969 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166857:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c969 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166866:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939b81924700) 00010000:00010000:2.0:1784045399.166868:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045399.166871:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c969 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166877:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454c969 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166892:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166899:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166904:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166909:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045399.166912:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166918:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166925:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045399.166927:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045399.166930:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca73 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166945:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454ca73 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166956:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ca96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166962:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ca96 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166967:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ca96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166980:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045399.166984:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ca96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166989:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ca96 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.166997:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045399.166999:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045399.167001:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ca96 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.167007:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ca96 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.167249:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045399.167257:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fcd4405/0x5475624df454cac7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.167265:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915ab400 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045399.167268:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fcd4405/0x5475624df454cac7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.167276:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fcd4405/0x5475624df454cac7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.167301:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fcd4405/0x5475624df454cac7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.167309:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fcd4405/0x5475624df454cac7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.167327:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045399.167329:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045399.167331:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784045399.168314:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045399.169664:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000004:00080000:1.0:1784045399.169775:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939c921f1f80/2, rc 0, transno 4294967302 00000100:00100000:1.0:1784045399.169785:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c921f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873864704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784045399.170625:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3625:x1870706873864704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4797us (5015us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1784045399.170699:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784045399.173457:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863286272 00000100:00100000:3.0:1784045399.173474:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863286272 00000100:00100000:3.0:1784045399.173549:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:3.0:1784045399.173562:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+12:11243:x1870706863286272:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1784045399.173828:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+13:11243:x1870706863286272:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 268us (4183us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1784045399.173853:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:1.0:1784045399.196681:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045399.196702:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c921f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873864832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045399.196770:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045399.196830:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873864832 00000100:00100000:1.0:1784045399.196839:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873864832 00000100:00100000:1.0:1784045399.197613:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1784045399.197622:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1870706873864832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045399.197653:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784045399.197706:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1870706873864832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045399.197714:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1784045399.198644:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c921f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873864832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045399.199416:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873864960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045399.199500:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045399.200359:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873864960 00000100:00100000:2.0:1784045399.200369:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873864960 00000100:00100000:2.0:1784045399.200436:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784045399.200462:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873864960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784045399.200487:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784045399.200550:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873864960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045399.200557:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784045399.200770:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873864960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045399.287248:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045399.287652:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863286528 00000100:00100000:2.0:1784045399.287663:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863286528 00000100:00100000:2.0:1784045399.287725:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:2.0:1784045399.287735:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+13:11249:x1870706863286528:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1784045399.287758:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045399.287780:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cace lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef3a expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.287892:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.287908:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cab2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef2c expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.287917:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.287948:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cab2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef2c expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.287962:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cab2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef2c expref: 14 pid: 6497 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045399.288004:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf550380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873865088:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045399.288114:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11e6180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045399.292918:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045399.293015:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863286656 00000100:00100000:0.0:1784045399.293024:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863286656 00010000:00010000:0.0:1784045399.293074:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cab2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef2c expref: 15 pid: 6497 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045399.293115:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:0.0:1784045399.293126:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:2394:x1870706863286656:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045399.293141:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045399.293148:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cab2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef2c expref: 15 pid: 6497 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.293161:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cab2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef2c expref: 15 pid: 6497 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.293183:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:0.0:1784045399.293202:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.293212:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.293219:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.293239:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045399.293295:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:2394:x1870706863286656:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 171us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045399.293303:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 57 00010000:00010000:2.0:1784045399.294041:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cab2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef2c expref: 14 pid: 6497 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045399.294072:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf550380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873865088:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045399.294093:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.294103:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.294109:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045399.294127:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1784045399.294261:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cace lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef3a expref: 15 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.294275:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef3a expref: 14 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.294284:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045399.294287:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784045399.294289:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171000, rc 0) 00000100:00100000:2.0:1784045399.294338:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:11249:x1870706863286528:12345-192.168.203.44@tcp:101:bash.0 Request processed in 6606us (7101us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1784045399.294354:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:1.0:1784045399.307858:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045399.307952:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863286912 00000100:00100000:0.0:1784045399.307962:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863286912 00000100:00100000:0.0:1784045399.308030:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:0.0:1784045399.308040:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:11249:x1870706863286912:12345-192.168.203.44@tcp:36:bash.0 00010000:00010000:0.0:1784045399.308276:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454cae3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.308294:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454cae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.308306:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454cae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784045399.308349:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1784045399.308370:0:10615:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000441b8586 reply state 00000000874cfde0 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454cae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.308382:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454cae3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.308412:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:0.0:1784045399.308415:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784045399.308418:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045399.308834:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:11249:x1870706863286912:12345-192.168.203.44@tcp:36:bash.0 Request processed in 793us (983us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1784045399.308842:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 68 00000020:00080000:0.0:1784045399.308847:0:10615:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784045399.320000:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045399.320138:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863287040 00000100:00100000:3.0:1784045399.320149:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863287040 00000100:00100000:3.0:1784045399.320206:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:3.0:1784045399.320216:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:11249:x1870706863287040:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1784045399.320239:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045399.320259:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454caea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef41 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.320370:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454caf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.320384:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef3a expref: 18 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.320405:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454caf1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.320441:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef3a expref: 18 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.320503:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef3a expref: 18 pid: 6496 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045399.320518:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf437100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873865216:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045399.324790:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92dfcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784045399.331966:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045399.333025:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863287168 00000100:00100000:3.0:1784045399.333034:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863287168 00010000:00010000:3.0:1784045399.333096:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef3a expref: 19 pid: 6496 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045399.333216:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf437100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873865216:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045399.333238:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454caf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045399.333468:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:3.0:1784045399.333479:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:2395:x1870706863287168:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045399.333494:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045399.333501:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef3a expref: 19 pid: 6496 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.333513:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef3a expref: 19 pid: 6496 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.333534:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cad5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef3a expref: 19 pid: 6496 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.333561:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:3.0:1784045399.333566:0:9500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454caf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.333575:0:9500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454caf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.333582:0:9500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454caf1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.333609:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045399.333668:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:2395:x1870706863287168:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 191us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045399.333676:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 58 00010000:00010000:2.0:1784045399.333734:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454caf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.333741:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454caf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045399.333794:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1784045399.333798:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045399.333817:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454caf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.333847:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454caea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef41 expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.333863:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454caf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef41 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.333871:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045399.333873:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045399.333876:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106e600, rc 0) 00000100:00100000:2.0:1784045399.333904:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:11249:x1870706863287040:12345-192.168.203.44@tcp:101:bash.0 Request processed in 13689us (13915us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045399.333920:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:1.0:1784045399.340005:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045399.341625:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863287424 00000100:00100000:3.0:1784045399.341639:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863287424 00000100:00100000:3.0:1784045399.341712:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:3.0:1784045399.341722:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9855cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:11249:x1870706863287424:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:3.0:1784045399.341957:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9855cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:11249:x1870706863287424:12345-192.168.203.44@tcp:35:bash.0 Request processed in 235us (1960us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1784045399.341966:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:1.0:1784045399.505615:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045399.505731:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863287680 00000100:00100000:2.0:1784045399.505740:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863287680 00000100:00100000:2.0:1784045399.505804:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:2.0:1784045399.505815:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:11259:x1870706863287680:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045399.505841:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045399.505862:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454caf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef48 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045399.505961:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1784045399.506070:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454caf8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef48 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.506085:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85b00) 00010000:00010000:2.0:1784045399.506088:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045399.506094:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454caf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef48 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.506109:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171600, rc 0) 00000100:00100000:2.0:1784045399.506171:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:11259:x1870706863287680:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 359us (565us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1784045399.506179:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:1.0:1784045399.516943:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045399.517066:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863287808 00000100:00100000:2.0:1784045399.517076:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863287808 00000100:00100000:2.0:1784045399.517136:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 71 00000100:00100000:2.0:1784045399.517146:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:11259:x1870706863287808:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:2.0:1784045399.517241:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb06 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517259:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517270:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517287:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517295:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517301:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517378:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517397:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517404:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045399.517485:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517498:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517515:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb06 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517522:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517528:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045399.517532:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517540:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517552:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:2.0:1784045399.517555:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045399.517559:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517566:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517580:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517586:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517592:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517598:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045399.517606:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517612:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517620:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939b82a43900) 00010000:00010000:2.0:1784045399.517623:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045399.517626:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517632:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517647:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517653:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517659:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517663:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2170200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045399.517666:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517672:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517679:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045399.517682:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045399.517691:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.517708:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045399.517785:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:11259:x1870706863287808:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 639us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045399.517794:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 71 00000100:00100000:1.0:1784045399.523571:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045399.523808:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863288064 00000100:00100000:3.0:1784045399.523818:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863288064 00000100:00100000:3.0:1784045399.523875:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:3.0:1784045399.523886:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:11259:x1870706863288064:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1784045399.524110:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:11259:x1870706863288064:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 225us (547us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1784045399.524117:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:1.0:1784045399.604652:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045399.605165:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863288320 00000100:00100000:0.0:1784045399.605174:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863288320 00000100:00100000:0.0:1784045399.607000:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 72 00000100:00100000:0.0:1784045399.607021:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:11262:x1870706863288320:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1784045399.607051:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045399.607073:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454cb1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef4f expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607148:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454cb22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607162:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454cb22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607172:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454cb22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607186:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454cb29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607192:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454cb29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607231:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454cb29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607368:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454cb30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607379:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454cb30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607396:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454cb30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045399.607407:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1784045399.607522:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454cb22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607530:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454cb22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607537:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454cb22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607542:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aaa00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045399.607546:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454cb22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607553:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454cb22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607564:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:0.0:1784045399.607567:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045399.607581:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454cb22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607586:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454cb22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607600:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454cb29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607606:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454cb29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607612:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454cb29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607616:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aae00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045399.607619:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454cb29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607624:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454cb29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607632:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939cb5a70100) 00010000:00010000:0.0:1784045399.607635:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045399.607637:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454cb29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607644:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454cb29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607689:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454cb1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef4f expref: 23 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607933:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454cb30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef4f expref: 22 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.607940:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:0.0:1784045399.607943:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045399.607945:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b3000, rc 0) 00000100:00100000:0.0:1784045399.608008:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11262:x1870706863288320:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 997us (3366us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1784045399.608015:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 72 00000100:00100000:1.0:1784045399.616981:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045399.617026:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045399.617121:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863288576 00000100:00100000:0.0:1784045399.617131:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863288576 00000100:00100000:0.0:1784045399.617199:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:2.0:1784045399.617204:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863288448 00000100:00100000:2.0:1784045399.617209:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863288448 00000100:00100000:0.0:1784045399.617219:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:2394:x1870706863288576:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045399.617236:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784045399.617248:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 73 00000100:00100000:2.0:1784045399.617255:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:11262:x1870706863288448:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:0.0:1784045399.617259:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454cb30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef4f expref: 23 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.617278:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:0.0:1784045399.617283:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045399.617309:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.617324:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045399.617330:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf610e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:2394:x1870706863288576:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 124us (304us total) trans 0 rc 0/0 00010000:00010000:2.0:1784045399.617333:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045399.617337:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5 00010000:00010000:2.0:1784045399.617372:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.617397:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.617403:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.617409:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2170200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045399.617433:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.617441:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.617473:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045399.617476:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045399.617480:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.617486:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cb3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045399.617522:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:11262:x1870706863288448:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 266us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045399.617528:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 73 00000100:00100000:1.0:1784045399.631899:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045399.632275:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863288832 00000100:00100000:3.0:1784045399.632284:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863288832 00000100:00100000:3.0:1784045399.632342:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:3.0:1784045399.632353:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:11262:x1870706863288832:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1784045399.633027:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11262:x1870706863288832:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 673us (1134us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1784045399.633037:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:1.0:1784045399.810366:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045399.816968:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863289088 00000100:00100000:2.0:1784045399.816984:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863289088 00000100:00100000:2.0:1784045399.817140:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 74 00000100:00100000:2.0:1784045399.817152:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11280:x1870706863289088:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:2.0:1784045399.817178:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045399.817200:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef56 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.817310:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb4c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.817325:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.817359:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045399.817372:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784045399.817524:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef56 expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.817553:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef56 expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.817562:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:2.0:1784045399.817566:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784045399.817569:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171600, rc 0) 00000100:00100000:2.0:1784045399.817639:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:11280:x1870706863289088:12345-192.168.203.44@tcp:101:cat.0 Request processed in 490us (7284us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1784045399.817662:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 74 00000100:00100000:1.0:1784045399.873560:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045399.875275:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863289216 00000100:00100000:2.0:1784045399.875289:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863289216 00000100:00100000:2.0:1784045399.875375:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 75 00000100:00100000:2.0:1784045399.875397:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:11281:x1870706863289216:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045399.875422:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045399.875479:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef5d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.875554:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cb61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.875586:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cb61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.875597:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cb61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045399.875641:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1784045399.875653:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045399.875679:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cb61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.876022:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cb5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef5d expref: 26 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.876053:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cb61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef5d expref: 25 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.876062:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:2.0:1784045399.876066:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045399.876069:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171200, rc 0) 00000100:00100000:2.0:1784045399.876202:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:11281:x1870706863289216:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 817us (2655us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045399.876209:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 75 00000100:00100000:1.0:1784045399.905374:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045399.905481:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863289600 00000100:00100000:0.0:1784045399.905491:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863289600 00000100:00100000:0.0:1784045399.905557:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:0.0:1784045399.905584:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:11281:x1870706863289600:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1784045399.905871:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+26:11281:x1870706863289600:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 288us (506us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1784045399.905879:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:0.0:1784045399.909088:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045399.909178:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863289728 00000100:00100000:3.0:1784045399.909188:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863289728 00000100:00100000:3.0:1784045399.909254:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:3.0:1784045399.909264:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+26:11281:x1870706863289728:12345-192.168.203.44@tcp:103:lfs.0 00010000:00010000:3.0:1784045399.909298:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784045399.909326:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454caf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef41 expref: 26 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.909351:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cb4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef56 expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.909364:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454c9e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eefb expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045399.909374:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:3.0:1784045399.909378:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045399.909441:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:11281:x1870706863289728:12345-192.168.203.44@tcp:103:lfs.0 Request processed in 179us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045399.909492:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:1.0:1784045399.923528:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045399.923907:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863289856 00000100:00100000:2.0:1784045399.923917:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863289856 00000100:00100000:2.0:1784045399.923985:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 76 00000100:00100000:2.0:1784045399.923995:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:11281:x1870706863289856:12345-192.168.203.44@tcp:58:lfs.0 00010000:00010000:2.0:1784045399.924126:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cb68 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.924148:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cb68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045399.924159:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cb68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784045399.924414:0:10615:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784045399.924591:0:10615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1784045399.924683:0:10615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1784045399.924772:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:11281:x1870706863289856:12345-192.168.203.44@tcp:58:lfs.0 Request processed in 777us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045399.924781:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 76 00000100:00100000:2.0:1784045399.957511:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045399.957612:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863289984 00000100:00100000:0.0:1784045399.957622:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863289984 00000100:00100000:0.0:1784045399.957696:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 77 00000100:00100000:0.0:1784045399.957707:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:11283:x1870706863289984:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1784045399.957725:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045399.957745:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cb6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef64 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.957834:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454cb76 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.957862:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454cb76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.957874:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454cb76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.957890:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454cb7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.957897:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454cb7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.957904:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454cb7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.957999:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cb84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958009:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958017:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045399.958070:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1784045399.958075:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784045399.958106:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958118:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cb84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958126:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454cb76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958133:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454cb76 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958139:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454cb76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958146:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045399.958150:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454cb76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958157:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454cb76 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958177:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:0.0:1784045399.958180:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045399.958186:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454cb76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958193:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454cb76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958206:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454cb7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958212:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454cb7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958218:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454cb7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958223:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045399.958226:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454cb7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958232:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454cb7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958239:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939cb5a70100) 00010000:00010000:0.0:1784045399.958242:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045399.958245:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454cb7d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958251:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454cb7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958295:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cb6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef64 expref: 25 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958308:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cb84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef64 expref: 24 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045399.958316:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:0.0:1784045399.958318:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784045399.958320:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b3600, rc 0) 00000100:00100000:0.0:1784045399.958395:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:11283:x1870706863289984:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 681us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045399.958402:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 77 00010000:00010000:1.0:1784045400.020922:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784045400.534735:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045400.534744:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045400.534781:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784045400.534788:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784045400.534938:0:13774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf553800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1870706873865344:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784045400.535019:0:13774:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83101d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045400.544259:0:13774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf553800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1870706873865344:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784045400.555195:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.555516:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863290112 00000100:00100000:3.0:1784045400.555527:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863290112 00000100:00100000:3.0:1784045400.555618:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 78 00000100:00100000:3.0:1784045400.555629:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:11294:x1870706863290112:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784045400.555674:0:10615:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784045400.555792:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:11294:x1870706863290112:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 164us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045400.555800:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 78 00000100:00080000:2.0:1784045400.556096:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045400.563748:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045400.563904:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863290240 00000100:00100000:0.0:1784045400.563914:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863290240 00000100:00100000:0.0:1784045400.563971:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 79 00000100:00100000:0.0:1784045400.563980:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:11294:x1870706863290240:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784045400.564060:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cb8b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564077:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cb8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564090:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cb8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564157:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454cb92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564178:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454cb92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564186:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454cb92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564213:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cb99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564222:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cb99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564228:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cb99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045400.564271:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1784045400.564275:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784045400.564287:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cb99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564298:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cb8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564305:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cb8b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564312:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cb8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564318:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045400.564322:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cb8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564335:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cb8b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564348:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c813ee300) 00010000:00010000:0.0:1784045400.564351:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045400.564355:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cb8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564361:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cb8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564375:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454cb92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564390:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454cb92 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564396:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454cb92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564402:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045400.564405:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454cb92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564411:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454cb92 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564418:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff939cb5a70300) 00010000:00010000:0.0:1784045400.564421:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045400.564423:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454cb92 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564439:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454cb92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564486:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cb99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564492:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cb99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564498:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cb99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564503:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045400.564506:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cb99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564513:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cb99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564522:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:0.0:1784045400.564524:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045400.564527:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cb99 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.564532:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cb99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045400.564610:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:11294:x1870706863290240:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 Request processed in 630us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045400.564618:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 79 00000100:00100000:1.0:1784045400.570942:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.571299:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863290496 00000100:00100000:3.0:1784045400.571307:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863290496 00000100:00100000:3.0:1784045400.571368:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 80 00000100:00100000:3.0:1784045400.571387:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:11294:x1870706863290496:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045400.571422:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045400.571461:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cba0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef6b expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.571568:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cba7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.571583:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.571595:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045400.571606:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784045400.571765:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cba7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.571774:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cba7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.571781:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cba7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.571787:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106ea00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045400.571792:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cba7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.571798:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cba7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.571811:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:3.0:1784045400.571820:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045400.571826:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cba7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.571832:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cba7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.571879:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cba0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef6b expref: 26 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.571890:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c813ee300) 00010000:00010000:3.0:1784045400.571892:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045400.571896:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cba0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef6b expref: 26 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.571954:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106e600, rc 0) 00000100:00100000:2.0:1784045400.577945:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:11294:x1870706863290496:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 6555us (7000us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1784045400.577959:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 80 00000100:00100000:1.0:1784045400.580625:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.580755:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863290624 00000100:00100000:3.0:1784045400.580765:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863290624 00000100:00100000:3.0:1784045400.580826:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 81 00000100:00100000:3.0:1784045400.580837:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:11294:x1870706863290624:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784045400.580871:0:6497:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784045400.581013:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:11294:x1870706863290624:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 178us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045400.581022:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 81 00000100:00100000:1.0:1784045400.594184:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.598284:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863290880 00000100:00100000:3.0:1784045400.598300:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863290880 00000100:00100000:3.0:1784045400.598394:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 82 00000100:00100000:3.0:1784045400.598407:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:11294:x1870706863290880:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045400.598489:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045400.598493:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784045400.598527:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cb61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef5d expref: 25 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.598549:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:3.0:1784045400.598554:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045400.598600:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454cbb5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef72 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784045400.599218:0:6498:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1784045400.599378:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cbbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.599419:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cbbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.599430:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cbbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.599544:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454cbb5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef72 expref: 27 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.599562:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cbbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef72 expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.599571:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939b82a43900) 00010000:00010000:2.0:1784045400.599573:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045400.599576:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171400, rc 0) 00000100:00100000:2.0:1784045400.599654:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+26:11294:x1870706863290880:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1250us (5480us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1784045400.599662:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 82 00000100:00100000:1.0:1784045400.604840:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.604915:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863291136 00000100:00100000:3.0:1784045400.604924:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863291136 00000100:00100000:3.0:1784045400.604989:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 83 00000100:00100000:3.0:1784045400.604999:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+26:11294:x1870706863291136:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045400.605070:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045400.605097:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cbbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef72 expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605116:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939b82a43900) 00010000:00010000:3.0:1784045400.605127:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045400.605152:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cbca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605173:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cbca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605182:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cbca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605197:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cbd1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x967adff9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605225:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cbd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x967adff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605233:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cbd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x967adff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605278:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cbca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605285:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cbca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605292:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cbca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605298:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106e600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045400.605302:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cbca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605310:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cbca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605319:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:3.0:1784045400.605322:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045400.605326:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cbca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605332:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cbca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605342:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cbd1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x967adff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605353:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cbd1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x967adff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605359:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cbd1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x967adff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605364:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106ea00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045400.605367:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cbd1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x967adff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605373:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cbd1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x967adff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605392:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x967adff9 (ffff939c93a83b00) 00010000:00010000:3.0:1784045400.605395:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045400.605397:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cbd1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x967adff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.605403:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cbd1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x967adff9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045400.605538:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:11294:x1870706863291136:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 539us (707us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784045400.605547:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 83 00000100:00100000:2.0:1784045400.615719:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.615847:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863291264 00000100:00100000:3.0:1784045400.615857:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863291264 00000100:00100000:3.0:1784045400.615939:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 84 00000100:00100000:3.0:1784045400.615950:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:11294:x1870706863291264:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045400.615969:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045400.616004:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cbd8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef79 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.616051:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cbdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.616065:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cbdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.616075:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cbdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.616194:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cbd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef79 expref: 27 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.616215:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cbdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef79 expref: 26 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.616223:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939c93a83f00) 00010000:00010000:3.0:1784045400.616226:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784045400.616229:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fda00, rc 0) 00000100:00100000:3.0:1784045400.616280:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+26:11294:x1870706863291264:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 332us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045400.616288:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 84 00000100:00100000:1.0:1784045400.622922:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.622989:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863291520 00000100:00100000:3.0:1784045400.623000:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863291520 00000100:00100000:3.0:1784045400.623063:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 85 00000100:00100000:3.0:1784045400.623072:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+26:11294:x1870706863291520:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045400.623157:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cbe6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.623191:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.623205:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784045400.623375:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1784045400.623397:0:6497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356731952240ns, next at 357731949356ns, rc = 0 00000004:00010000:3.0:1784045400.623484:0:6497:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000015d26f2 reply state 00000000dac9896d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.623498:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cbe6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.623506:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939c93a83f00) 00010000:00010000:3.0:1784045400.623510:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784045400.623514:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045400.623601:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+28:11294:x1870706863291520:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 529us (689us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1784045400.623608:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 85 00000100:00100000:1.0:1784045400.629904:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.630074:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863291648 00000100:00100000:3.0:1784045400.630085:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863291648 00000100:00100000:3.0:1784045400.630146:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 86 00000100:00100000:3.0:1784045400.630157:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+28:11294:x1870706863291648:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045400.630181:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045400.630201:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cbed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef80 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.630278:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cbed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef80 expref: 29 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.630293:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cbed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef80 expref: 29 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.630317:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939c93a83f00) 00010000:00010000:3.0:1784045400.630320:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784045400.630323:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93e78600, rc 0) 00000100:00100000:3.0:1784045400.630399:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:11294:x1870706863291648:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 244us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045400.630406:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 86 00000100:00100000:1.0:1784045400.638369:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045400.642670:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863291776 00000100:00100000:2.0:1784045400.642690:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863291776 00000100:00100000:2.0:1784045400.642749:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:2.0:1784045400.642758:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1870706863291776:12345-192.168.203.44@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1784045400.642793:0:8411:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:2.0:1784045400.642839:0:8411:0:(genops.c:1406:class_connect()) connect: client bbcbf11d-b5f2-42a6-9759-7590eb85aa60, cookie 0x5475624df454cbf4 00002000:00100000:2.0:1784045400.642852:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bbcbf11d-b5f2-42a6-9759-7590eb85aa60/ffff939b8405f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784045400.642877:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:2.0:1784045400.642953:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784045400.642985:0:8411:0:(import.c:65:import_set_state_nolock()) ffff939b8405e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045400.643062:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2393:x1870706863291776:12345-192.168.203.44@tcp:8:lhsmtool_posix.0 Request processed in 304us (4700us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045400.643070:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:0.0:1784045400.665829:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045400.665884:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863291904 00000100:00100000:0.0:1784045400.665893:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863291904 00000100:00100000:0.0:1784045400.665954:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:0.0:1784045400.665963:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:0:x1870706863291904:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1784045400.666113:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1784045400.667773:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1784045400.667784:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000100:00100000:0.0:1784045400.667912:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:0:x1870706863291904:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 1945us (2088us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1784045400.667923:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:3.0:1784045400.688054:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045400.688126:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863292160 00000100:00100000:0.0:1784045400.688136:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863292160 00000100:00100000:0.0:1784045400.688206:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:0.0:1784045400.688217:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:11294:x1870706863292160:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784045400.688497:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:11294:x1870706863292160:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 281us (452us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1784045400.688505:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:1.0:1784045400.699808:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.699943:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863292416 00000100:00100000:3.0:1784045400.699953:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863292416 00000100:00100000:3.0:1784045400.700055:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 87 00000100:00100000:3.0:1784045400.700066:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:11294:x1870706863292416:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784045400.700186:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:11294:x1870706863292416:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 121us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045400.700194:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 87 00000100:00100000:0.0:1784045400.730106:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.739183:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863292544 00000100:00100000:3.0:1784045400.739198:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863292544 00000100:00100000:2.0:1784045400.739346:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 88 00000100:00100000:2.0:1784045400.739357:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:11294:x1870706863292544:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045400.739389:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045400.739409:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cbfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef87 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.739517:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cc02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.739531:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cc02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.739541:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cc02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045400.739584:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045400.739604:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cc02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.739631:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cbfb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef87 expref: 32 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.739717:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cc02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef87 expref: 31 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.739733:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939c93a83f00) 00010000:00010000:2.0:1784045400.739735:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784045400.739739:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171800, rc 0) 00000100:00100000:2.0:1784045400.739803:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+31:11294:x1870706863292544:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 447us (9706us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045400.739810:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 88 00000100:00100000:2.0:1784045400.757004:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045400.757052:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863292672 00000100:00100000:2.0:1784045400.757063:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863292672 00000100:00100000:2.0:1784045400.757114:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:2.0:1784045400.757123:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863292672:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045400.757140:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045400.757163:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000769c7492/0x5475624df454cc09 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef8e expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045400.757189:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565f58, blocks: 0x0 00010000:00010000:2.0:1784045400.757208:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=356s v=(0 0) 00010000:00010000:2.0:1784045400.757213:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045400.757222:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000769c7492/0x5475624df454cc09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef8e expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.757241:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000769c7492/0x5475624df454cc09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef8e expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.757255:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2170200, rc 0) 00000100:00100000:2.0:1784045400.757313:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf551180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863292672:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 191us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045400.757321:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:1.0:1784045400.765889:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.766048:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863292928 00000100:00100000:3.0:1784045400.766058:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863292928 00000100:00100000:3.0:1784045400.766120:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89 00000100:00100000:3.0:1784045400.766130:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+31:11294:x1870706863292928:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784045400.766255:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+31:11294:x1870706863292928:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 126us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045400.766264:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89 00000100:00100000:0.0:1784045400.776903:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045400.777191:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863293056 00000100:00100000:1.0:1784045400.777201:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863293056 00000100:00100000:1.0:1784045400.777292:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:1.0:1784045400.777302:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:11294:x1870706863293056:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045400.777320:0:8648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045400.777342:0:8648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2730acd/0x5475624df454cc10 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef95 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.777373:0:8648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000769c7492/0x5475624df454cc09 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef8e expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.777392:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045400.777396:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045400.777402:0:8648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2730acd/0x5475624df454cc10 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef95 expref: 7 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.777437:0:8648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000769c7492/0x5475624df454cc09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef8e expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.777467:0:8648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000769c7492/0x5475624df454cc09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef8e expref: 7 pid: 8412 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045400.777482:0:8648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8648:1870706873865472:192.168.203.44@tcp:104: 00000100:00100000:1.0:1784045400.777567:0:8648:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c91584b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784045400.780795:0:8648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8648:1870706873865472:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045400.780831:0:8648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2730acd/0x5475624df454cc10 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef95 expref: 7 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.780876:0:8648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cd400, rc 0) 00000100:00100000:1.0:1784045400.780936:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:11294:x1870706863293056:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 3634us (4041us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045400.780945:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:2.0:1784045400.787059:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045400.788036:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863293184 00000100:00100000:0.0:1784045400.788047:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863293184 00010000:00010000:0.0:1784045400.788089:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000769c7492/0x5475624df454cc09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef8e expref: 7 pid: 8412 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045400.788131:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:0.0:1784045400.788141:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863293184:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045400.788163:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045400.788186:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000769c7492/0x5475624df454cc09 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef8e expref: 7 pid: 8412 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.788200:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000769c7492/0x5475624df454cc09 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef8e expref: 7 pid: 8412 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.788224:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000769c7492/0x5475624df454cc09 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef8e expref: 7 pid: 8412 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.788239:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045400.788243:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045400.788251:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2730acd/0x5475624df454cc10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef95 expref: 6 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.788260:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2730acd/0x5475624df454cc10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef95 expref: 6 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.788297:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e2730acd/0x5475624df454cc10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef95 expref: 6 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045400.788311:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88335f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1870706873865600:192.168.203.44@tcp:105: 00000100:00100000:0.0:1784045400.788401:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81540 going to sleep for 11 seconds 00000100:00100000:0.0:1784045400.791420:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88335f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1870706873865600:192.168.203.44@tcp:105: 00010000:00010000:0.0:1784045400.791470:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045400.791541:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863293184:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 3400us (4490us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045400.791552:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:0.0:1784045400.796607:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.796717:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863293312 00000100:00100000:3.0:1784045400.796727:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863293312 00002000:00100000:3.0:1784045400.796774:0:8419:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff939c88335f80 x1870706863293312/t0(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:41/0 lens 504/0 e 0 to 0 dl 1784045411 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784045400.796785:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939c88335f80 with x1870706863293312 ext(0->8) 00002000:00010000:3.0:1784045400.796790:0:8419:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939c88335f80 00000100:00100000:3.0:1784045400.796825:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:3.0:1784045400.796835:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863293312:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1784045400.798137:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2394:x1870706863293312:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 Request processed in 1295us (1530us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1784045400.798149:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00002000:00100000:3.0:1784045400.798159:0:8419:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff939c88335f80 x1870706863293312/t4294967303(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:41/0 lens 504/448 e 0 to 0 dl 1784045411 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784045400.798169:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939c88335f80 with x1870706863293312 ext(0->8) 00002000:00010000:3.0:1784045400.798175:0:8419:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939c88335f80 00000100:00100000:2.0:1784045400.811516:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045400.811561:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863293440 00000100:00100000:2.0:1784045400.811571:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863293440 00000100:00100000:2.0:1784045400.811627:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 90 00000100:00100000:2.0:1784045400.811637:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+31:11294:x1870706863293440:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784045400.827597:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1784045400.827617:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1784045400.827665:0:6475:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:0.0:1784045400.828513:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454cae3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.828527:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454cae3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.828535:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454cae3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.828540:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915ab400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045400.828545:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454cae3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.828553:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454cae3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.828570:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:0.0:1784045400.828573:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045400.828577:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454cae3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.828584:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454cae3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.828603:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cbe6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.828610:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cbe6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.828623:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cbe6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.828627:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045400.828630:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cbe6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.828638:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cbe6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.828646:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939c93a83f00) 00010000:00010000:0.0:1784045400.828648:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784045400.828651:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cbe6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.828664:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cbe6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1784045400.828685:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1784045400.828695:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1784045400.828870:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045400.828888:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873865728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784045400.828951:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045400.829252:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873865728 00000100:00100000:0.0:1784045400.829260:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873865728 00000100:00100000:0.0:1784045400.829322:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784045400.829332:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873865728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1784045400.829499:0:9935:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784045400.829503:0:9935:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1784045400 00002000:00010000:0.0:1784045400.829505:0:9935:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784045400.829508:0:9935:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1784045400 -> 1784045400 00002000:00010000:0.0:1784045400.829509:0:9935:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1784045400.829578:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3626:x1870706873865728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 248us (627us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1784045400.829587:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1784045400.829609:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1784045400.829641:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939cbf437100/2, rc 0, transno 4294967304 00000100:00100000:0.0:1784045400.829648:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873865728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784045400.831128:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:11294:x1870706863293440:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 Request processed in 19485us (19615us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045400.831141:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 90 00000040:00080000:2.0:1784045400.831350:0:14188:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045400.831354:0:14188:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045400.831388:0:14188:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784045400.831394:0:14188:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784045400.835478:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045400.835619:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863293568 00000100:00100000:2.0:1784045400.835629:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863293568 00000100:00100000:2.0:1784045400.835717:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:2.0:1784045400.835727:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2394:x1870706863293568:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1784045400.838642:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1784045400.838671:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1784045400.838941:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863293568:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 Request processed in 3211us (3463us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045400.838953:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:0.0:1784045400.841424:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.841500:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863293824 00000100:00100000:3.0:1784045400.841510:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863293824 00000100:00100000:3.0:1784045400.841564:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 91 00000100:00100000:3.0:1784045400.841573:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:11294:x1870706863293824:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045400.841619:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045400.841651:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cc02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef87 expref: 14 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.841673:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939c93a83f00) 00010000:00010000:3.0:1784045400.841677:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045400.841704:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cc17 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.841716:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cc17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.841725:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cc17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045400.841847:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017245fa0 reply state 00000000a9932ff5 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cc17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.841858:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cc17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.841865:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939c93a83f00) 00010000:00010000:3.0:1784045400.841868:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784045400.841870:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045400.841975:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:11294:x1870706863293824:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 401us (558us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1784045400.841988:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 91 00000100:00100000:3.0:1784045400.845728:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045400.849651:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863293952 00000100:00100000:0.0:1784045400.849665:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863293952 00000100:00100000:0.0:1784045400.849735:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:0.0:1784045400.849745:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863293952:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784045400.849921:0:8648:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1784045400.849925:0:8648:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1784045400 -> 1784045398 00002000:00010000:0.0:1784045400.849927:0:8648:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1784045396 00002000:00010000:0.0:1784045400.849929:0:8648:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1784045400 -> 1784045398 00002000:00010000:0.0:1784045400.849932:0:8648:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1784045400.850005:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2396:x1870706863293952:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 260us (4286us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1784045400.850013:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:0.0:1784045400.856071:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045400.856134:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863294208 00000100:00100000:2.0:1784045400.856144:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863294208 00000100:00100000:2.0:1784045400.856209:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 92 00000100:00100000:2.0:1784045400.856220:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:11294:x1870706863294208:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784045400.856299:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.856315:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cbdf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef79 expref: 15 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.856325:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.856362:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cbdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef79 expref: 15 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.856387:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cbdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef79 expref: 15 pid: 10615 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045400.856403:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf550a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1870706873865856:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045400.856516:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83101e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045400.866830:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.866864:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863294336 00000100:00100000:3.0:1784045400.866872:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863294336 00010000:00010000:3.0:1784045400.867271:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cbdf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef79 expref: 16 pid: 10615 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045400.867311:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:3.0:1784045400.867321:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:2395:x1870706863294336:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045400.867335:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045400.867341:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cbdf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef79 expref: 16 pid: 10615 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867353:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cbdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef79 expref: 16 pid: 10615 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867387:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939c93a83f00) 00010000:00010000:3.0:1784045400.867393:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867402:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867410:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867428:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045400.867504:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:2395:x1870706863294336:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 183us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045400.867513:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 60 00010000:00010000:3.0:1784045400.867643:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cbdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef79 expref: 15 pid: 10615 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045400.867659:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf550a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1870706873865856:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045400.867680:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867688:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867694:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867729:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867737:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867743:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867749:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045400.867753:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867760:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867780:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939c93a83f00) 00010000:00010000:3.0:1784045400.867783:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784045400.867787:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.867794:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cc1e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045400.867839:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:11294:x1870706863294208:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 Request processed in 11622us (11778us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784045400.867847:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 92 00000100:00100000:1.0:1784045400.879033:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045400.879103:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863294464 00000100:00100000:3.0:1784045400.879113:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863294464 00000100:00100000:3.0:1784045400.879172:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:3.0:1784045400.879182:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2397:x1870706863294464:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784045400.879223:0:8412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.879243:0:8412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2730acd/0x5475624df454cc10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef95 expref: 7 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.879252:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045400.879256:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045400.879261:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.879293:0:8412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2730acd/0x5475624df454cc10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef95 expref: 7 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.879313:0:8412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2730acd/0x5475624df454cc10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef95 expref: 7 pid: 8648 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045400.879328:0:8412:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8412:1870706873865984:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045400.879417:0:8412:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d1840 going to sleep for 11 seconds 00000100:00100000:1.0:1784045400.881471:0:8412:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8412:1870706873865984:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045400.881503:0:8412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045400.893235:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045400.893318:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863294592 00000100:00100000:2.0:1784045400.893328:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863294592 00010000:00010000:2.0:1784045400.893375:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2730acd/0x5475624df454cc10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef95 expref: 8 pid: 8648 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045400.893429:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:2.0:1784045400.893439:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2395:x1870706863294592:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045400.893480:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045400.893502:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000e2730acd/0x5475624df454cc10 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef95 expref: 8 pid: 8648 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.893531:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2730acd/0x5475624df454cc10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef95 expref: 8 pid: 8648 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.893557:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2730acd/0x5475624df454cc10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef95 expref: 8 pid: 8648 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.893574:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1784045400.893578:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045400.893584:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.893595:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.893631:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045400.893670:0:8412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.893683:0:8412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045400.893697:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863294592:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 259us (471us total) trans 0 rc 0/0 00010000:00010000:1.0:1784045400.893703:0:8412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045400.893710:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 61 00010000:00010000:1.0:1784045400.893718:0:8412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.893727:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.893747:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045400.893752:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.893761:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.893777:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.893784:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068846607/0x5475624df454cc25 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045400.893837:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2397:x1870706863294464:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 Request processed in 14656us (14814us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045400.893846:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:2.0:1784045400.898011:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045400.898109:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863294848 00000100:00100000:0.0:1784045400.898118:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863294848 00000100:00100000:0.0:1784045400.898180:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 93 00000100:00100000:0.0:1784045400.898190:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:11294:x1870706863294848:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784045400.898268:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.898292:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ca6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef1e expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.898302:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.898338:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ca6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef1e expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.898350:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ca6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef1e expref: 14 pid: 6497 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045400.898365:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83caad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873866112:192.168.203.44@tcp:104: 00000100:00100000:0.0:1784045400.898492:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045400.901513:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045400.901603:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83caad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873866112:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045400.901628:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045400.901854:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863294976 00000100:00100000:3.0:1784045400.901861:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863294976 00010000:00010000:3.0:1784045400.901894:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ca6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef1e expref: 15 pid: 6497 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045400.901942:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:3.0:1784045400.901950:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe49050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:2395:x1870706863294976:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045400.901965:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045400.902172:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ca6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef1e expref: 15 pid: 6497 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.902187:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ca6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef1e expref: 15 pid: 6497 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.902213:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ca6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef1e expref: 15 pid: 6497 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.902231:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:3.0:1784045400.902235:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.902268:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.902278:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.902344:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045400.902413:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe49050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:2395:x1870706863294976:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 462us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045400.902421:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 62 00010000:00010000:0.0:1784045400.904361:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.904374:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.904623:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.904765:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cbed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef80 expref: 14 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.904784:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.904823:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cbed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef80 expref: 14 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045400.904838:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cbed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef80 expref: 14 pid: 10615 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045400.904854:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83caad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873866240:192.168.203.44@tcp:104: 00000100:00100000:0.0:1784045400.907544:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045400.913112:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045400.913164:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863295104 00000100:00100000:0.0:1784045400.913171:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83caad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873866240:192.168.203.44@tcp:104: 00000100:00100000:1.0:1784045400.913173:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863295104 00010000:00010000:0.0:1784045400.913200:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.913214:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cbed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef80 expref: 15 pid: 10615 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045400.913263:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:1.0:1784045400.913272:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83cab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:2395:x1870706863295104:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045400.913286:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045400.913301:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cbed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef80 expref: 15 pid: 10615 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.913313:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cbed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef80 expref: 15 pid: 10615 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.913336:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cbed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef80 expref: 15 pid: 10615 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.913349:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939c93a83f00) 00010000:00010000:1.0:1784045400.913353:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.913361:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.913370:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.913405:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045400.913475:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83cab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:2395:x1870706863295104:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 203us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045400.913483:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 63 00010000:00010000:1.0:1784045400.913512:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.913520:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784045400.913616:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1784045400.913718:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1784045400.913760:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1784045400.914014:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83caad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1870706873866368:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784045400.914066:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045400.914097:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784045400.914838:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873866368 00000100:00100000:1.0:1784045400.914847:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873866368 00000100:00100000:1.0:1784045400.914949:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784045400.914958:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6497:x1870706873866368:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784045400.915074:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6497:x1870706873866368:12345-0@lo:1000:mdt00_001.0 Request processed in 117us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045400.915081:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784045400.917059:0:6497:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1784045400.917070:0:6497:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939cbf437100, transno 4294967304 00000100:00100000:3.0:1784045400.917100:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83caad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1870706873866368:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1784045400.917291:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1784045400.917363:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1870706873866496:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784045400.917432:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045400.917486:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff939ca0090780 going to sleep for 11 seconds 00000100:00100000:0.0:1784045400.917487:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873866496 00000100:00100000:0.0:1784045400.917495:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873866496 00000100:00100000:0.0:1784045400.917540:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784045400.917551:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6497:x1870706873866496:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784045400.917690:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6497:x1870706873866496:12345-0@lo:1000:mdt00_001.0 Request processed in 141us (258us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784045400.917698:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784045400.919602:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6497:1870706873866496:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1784045400.919657:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919668:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919676:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919682:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045400.919700:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919707:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919724:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939c93a83f00) 00010000:00010000:3.0:1784045400.919727:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784045400.919731:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919737:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454cc33 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919768:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cb68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919775:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cb68 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919780:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cb68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919785:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2170000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045400.919788:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cb68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919793:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cb68 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919801:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:3.0:1784045400.919803:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784045400.919813:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cb68 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919819:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cb68 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919848:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919876:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cb84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef64 expref: 17 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919885:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919922:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cb84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef64 expref: 17 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.919935:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cb84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef64 expref: 17 pid: 6496 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045400.919948:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873866624:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045400.920034:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b8222f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045400.927359:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045400.927552:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863295232 00000100:00100000:1.0:1784045400.927562:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863295232 00010000:00010000:1.0:1784045400.927601:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cb84 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef64 expref: 18 pid: 6496 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045400.927637:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:1.0:1784045400.927647:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:2395:x1870706863295232:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045400.927663:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045400.927670:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cb84 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef64 expref: 18 pid: 6496 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.927683:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cb84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef64 expref: 18 pid: 6496 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.927705:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:1.0:1784045400.927711:0:9500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.927721:0:9500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.927740:0:9500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.927759:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045400.927811:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:2395:x1870706863295232:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 165us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045400.927819:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 64 00010000:00010000:3.0:1784045400.930271:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cb84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73ef64 expref: 17 pid: 6496 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045400.930292:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6925500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873866624:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045400.930313:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.930336:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.930341:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.930353:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.930360:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.930367:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.930374:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045400.930387:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.930395:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.930410:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:3.0:1784045400.930414:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045400.930418:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.930424:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc3a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.930436:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.933598:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.933607:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.933613:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045400.933618:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.933627:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.933645:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939b82a43700) 00010000:00010000:3.0:1784045400.933648:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784045400.933653:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045400.933660:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cc2c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045400.933870:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf552d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:11294:x1870706863294848:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 35664us (35853us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1784045400.933882:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 93 00000020:00080000:3.0:1784045400.933889:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784045400.934014:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784045400.934020:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784045400.934037:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784045400.934044:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784045400.956125:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045400.956415:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863295488 00000100:00100000:2.0:1784045400.956425:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863295488 00000100:00100000:2.0:1784045400.956705:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:2.0:1784045400.956717:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:11294:x1870706863295488:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1784045400.956996:0:6499:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1784045400.957029:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1784045400.957071:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cc41 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.957087:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cc41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.957098:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cc41 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.957106:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cc41 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.957112:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cc41 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.957117:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cc41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045400.957194:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784045400.957299:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:11294:x1870706863295488:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 583us (1181us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1784045400.957308:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00000020:00080000:2.0:1784045400.957312:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784045400.958086:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045400.958095:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cc41 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.958104:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171600 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045400.958108:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cc41 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.958116:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cc41 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.958130:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939c93a83f00) 00010000:00010000:1.0:1784045400.958133:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784045400.958138:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cc41 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.958144:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cc41 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045400.958156:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045400.958158:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045400.958159:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045401.043806:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045401.748919:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873866752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045401.748991:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045401.749113:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873866752 00000100:00100000:2.0:1784045401.749121:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873866752 00000100:00100000:2.0:1784045401.749173:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784045401.749183:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1870706873866752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045401.749205:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1784045401.749263:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1870706873866752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045401.749270:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784045401.749348:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873866752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045401.749751:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045401.749763:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873866880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045401.749795:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045401.749967:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873866880 00000100:00100000:1.0:1784045401.749981:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873866880 00000100:00100000:1.0:1784045401.750027:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784045401.750035:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873866880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045401.750048:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1784045401.750086:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873866880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045401.750092:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784045401.750131:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873866880:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784045401.750192:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784045402.069596:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045402.261574:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c921f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873867008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784045402.261648:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045402.261724:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873867008 00000100:00100000:3.0:1784045402.261731:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873867008 00000100:00100000:3.0:1784045402.261778:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784045402.261788:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873867008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045402.261822:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045402.261867:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873867008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045402.261875:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784045402.261919:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c921f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873867008:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1784045402.779526:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1784045402.779722:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000040:00080000:0.0:1784045402.895737:0:14239:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045402.895746:0:14239:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045402.895769:0:14239:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784045402.895778:0:14239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784045403.056412:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045403.056545:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863295744 00000100:00100000:3.0:1784045403.056555:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863295744 00000100:00100000:3.0:1784045403.056632:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 94 00000100:00100000:3.0:1784045403.056643:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:11313:x1870706863295744:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045403.056672:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045403.056696:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73ef9c expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.056821:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454cc4f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.056837:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454cc4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.056868:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454cc4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045403.056881:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1784045403.056983:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef9c expref: 21 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.057002:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454cc4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef9c expref: 20 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.057009:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:3.0:1784045403.057012:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784045403.057015:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93e79200, rc 0) 00000100:00100000:3.0:1784045403.057076:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:11313:x1870706863295744:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 434us (674us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1784045403.057083:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 94 00000100:00080000:0.0:1784045403.057324:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045403.062849:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.068037:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863295872 00000100:00100000:2.0:1784045403.068051:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863295872 00000100:00100000:3.0:1784045403.068295:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 95 00000100:00100000:3.0:1784045403.068306:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:11313:x1870706863295872:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:3.0:1784045403.068387:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc5d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068406:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068417:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068431:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068471:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068478:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068571:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cc6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068580:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068587:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045403.068632:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068645:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc5d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068651:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc5d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068658:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068665:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045403.068669:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc5d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068677:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc5d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068695:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:3.0:1784045403.068698:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045403.068703:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068718:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068730:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068736:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068742:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068748:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045403.068751:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068756:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068764:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939c93a83c00) 00010000:00010000:3.0:1784045403.068766:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045403.068769:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc64 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068775:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068811:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068818:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cc6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068823:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cc6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068827:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045403.068830:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cc6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068835:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cc6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068842:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83400) 00010000:00010000:3.0:1784045403.068844:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045403.068847:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cc6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.068852:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cc6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045403.068932:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:11313:x1870706863295872:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 626us (6091us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045403.068940:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 95 00010000:00010000:0.0:1784045403.097160:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045403.120069:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045403.120854:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863296128 00000100:00100000:3.0:1784045403.120866:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863296128 00000100:00100000:3.0:1784045403.120931:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 96 00000100:00100000:3.0:1784045403.120951:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:11316:x1870706863296128:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045403.120972:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045403.120995:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cc72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73efa3 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121069:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc79 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121083:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121096:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121111:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121118:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121125:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121228:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121236:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121244:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045403.121264:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1784045403.121352:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121360:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc79 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121375:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121381:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045403.121386:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121394:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc79 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121405:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:3.0:1784045403.121408:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045403.121412:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121418:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cc79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121432:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121439:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121479:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121484:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045403.121487:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121494:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121502:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939c93a83400) 00010000:00010000:3.0:1784045403.121504:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045403.121507:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc80 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121513:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cc80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121570:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cc72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efa3 expref: 23 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121584:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efa3 expref: 22 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.121591:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:3.0:1784045403.121593:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045403.121595:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93e78e00, rc 0) 00000100:00100000:3.0:1784045403.121664:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11316:x1870706863296128:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 715us (1607us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1784045403.121680:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 96 00000100:00100000:3.0:1784045403.131917:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045403.133303:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863296256 00000100:00100000:3.0:1784045403.133317:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863296256 00000100:00100000:3.0:1784045403.133419:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 97 00000100:00100000:3.0:1784045403.133431:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11316:x1870706863296256:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:3.0:1784045403.133529:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cc95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.133545:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cc95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.133557:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cc95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.133592:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cc95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.133600:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cc95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.133606:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cc95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.133612:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fd800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045403.133617:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cc95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.133624:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cc95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.133648:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:3.0:1784045403.133651:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045403.133656:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cc95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.133662:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cc95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045403.133826:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11316:x1870706863296256:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 398us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045403.133834:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 97 00000100:00100000:1.0:1784045403.144884:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.144927:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863296512 00000100:00100000:1.0:1784045403.144936:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863296512 00000100:00100000:1.0:1784045403.144989:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:1.0:1784045403.144999:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9855e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11316:x1870706863296512:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:1.0:1784045403.145217:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9855e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:11316:x1870706863296512:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 219us (344us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1784045403.145224:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:2.0:1784045403.191643:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045403.191721:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863296768 00000100:00100000:3.0:1784045403.191731:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863296768 00000100:00100000:3.0:1784045403.191797:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 98 00000100:00100000:3.0:1784045403.191807:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:10834:x1870706863296768:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1784045403.191832:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045403.191851:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cc9c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73efaa expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.191961:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.191975:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efa3 expref: 24 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.191984:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.192017:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efa3 expref: 24 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.192046:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efa3 expref: 24 pid: 10615 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045403.192060:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873867136:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045403.192162:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b81096000 going to sleep for 11 seconds 00000100:00100000:3.0:1784045403.196188:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045403.196267:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873867136:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045403.196293:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045403.196378:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863296896 00000100:00100000:1.0:1784045403.196386:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863296896 00010000:00010000:1.0:1784045403.196421:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efa3 expref: 25 pid: 10615 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045403.196498:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 65 00000100:00100000:1.0:1784045403.196509:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:2395:x1870706863296896:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045403.196525:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045403.196547:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efa3 expref: 25 pid: 10615 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.196560:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efa3 expref: 25 pid: 10615 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.196583:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cc87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efa3 expref: 25 pid: 10615 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.196600:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:1.0:1784045403.196606:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.196615:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.196622:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.196652:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045403.196705:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:2395:x1870706863296896:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 198us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045403.196713:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 65 00010000:00010000:0.0:1784045403.196908:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.196916:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045403.196935:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1784045403.197066:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cc9c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efaa expref: 25 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.197082:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efaa expref: 24 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.197098:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:0.0:1784045403.197100:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784045403.197103:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fd800, rc 0) 00000100:00100000:0.0:1784045403.197141:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf551880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:10834:x1870706863296768:12345-192.168.203.44@tcp:101:bash.0 Request processed in 5335us (5508us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1784045403.197149:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 98 00000100:00100000:3.0:1784045403.201430:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.201560:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863297024 00000100:00100000:2.0:1784045403.201569:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863297024 00000100:00100000:2.0:1784045403.201630:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 99 00000100:00100000:2.0:1784045403.201640:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:10834:x1870706863297024:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1784045403.201664:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045403.201686:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccb1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73efb1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.201734:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454ccb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.201748:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454ccb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.201759:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454ccb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.201873:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efb1 expref: 26 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.201892:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454ccb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efb1 expref: 25 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.201899:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:2.0:1784045403.201909:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784045403.201913:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2170a00, rc 0) 00000100:00100000:2.0:1784045403.201974:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:10834:x1870706863297024:12345-192.168.203.44@tcp:101:bash.0 Request processed in 335us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.201980:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 99 00000100:00100000:1.0:1784045403.207533:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.208195:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863297280 00000100:00100000:2.0:1784045403.208206:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863297280 00000100:00100000:2.0:1784045403.208312:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 100 00000100:00100000:2.0:1784045403.208324:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:10834:x1870706863297280:12345-192.168.203.44@tcp:36:bash.0 00010000:00010000:2.0:1784045403.208600:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccbf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.208617:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.208628:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045403.208791:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1784045403.208815:0:6498:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054d5301c reply state 000000002700570c transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.208830:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.208837:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:2.0:1784045403.208839:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784045403.208843:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1784045403.208880:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1784045403.209216:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:10834:x1870706863297280:12345-192.168.203.44@tcp:36:bash.0 Request processed in 893us (1691us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1784045403.209241:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 100 00000020:00080000:2.0:1784045403.209246:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1784045403.211994:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.212788:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863297408 00000100:00100000:2.0:1784045403.212800:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863297408 00000100:00100000:2.0:1784045403.212870:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 101 00000100:00100000:2.0:1784045403.212882:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:10834:x1870706863297408:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1784045403.212910:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045403.212932:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ccc6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73efb8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.212990:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ccc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efb8 expref: 30 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.213004:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ccc6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efb8 expref: 30 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.213024:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:2.0:1784045403.213027:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045403.213030:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171600, rc 0) 00000100:00100000:2.0:1784045403.213163:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:10834:x1870706863297408:12345-192.168.203.44@tcp:101:bash.0 Request processed in 282us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.213171:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 101 00000100:00100000:3.0:1784045403.220531:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.220596:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863297536 00000100:00100000:2.0:1784045403.220607:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863297536 00000100:00100000:2.0:1784045403.220796:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:2.0:1784045403.220807:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:10834:x1870706863297536:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1784045403.220844:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045403.220865:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba70f9d2/0x5475624df454cccd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73efbf expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045403.220890:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a565f56, atime: 0x6a565f54, ctime: 0x6a565f56, blocks: 0x8 00010000:00010000:2.0:1784045403.220912:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1784045403.220917:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045403.220925:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba70f9d2/0x5475624df454cccd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efbf expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.220945:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba70f9d2/0x5475624df454cccd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efbf expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.220958:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2170000, rc 0) 00000100:00100000:2.0:1784045403.221018:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:10834:x1870706863297536:12345-192.168.203.44@tcp:101:bash.0 Request processed in 214us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.221034:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00080000:0.0:1784045403.222808:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045403.225951:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.226117:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863297664 00000100:00100000:2.0:1784045403.226127:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863297664 00002000:00010000:2.0:1784045403.226170:0:8417:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1784045403.226174:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939cbf610380 with x1870706863297664 ext(0->18446744073709551615) 00002000:00010000:2.0:1784045403.226187:0:8417:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939cbf610380. 00000100:00100000:2.0:1784045403.226229:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:2.0:1784045403.226239:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863297664:12345-192.168.203.44@tcp:10:bash.0 00002000:00010000:2.0:1784045403.226577:0:8417:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1784045403.226592:0:8417:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1784045398 -> 1784045402 00002000:00010000:2.0:1784045403.226594:0:8417:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1784045396 -> 1784045396 00002000:00010000:2.0:1784045403.226597:0:8417:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1784045398 -> 1784045402 00002000:00010000:2.0:1784045403.226599:0:8417:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1784045403.226979:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2394:x1870706863297664:12345-192.168.203.44@tcp:10:bash.0 Request processed in 739us (1037us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784045403.226989:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1 00002000:00010000:2.0:1784045403.226993:0:8417:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1784045403.226996:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939cbf610380 with x1870706863297664 ext(0->18446744073709551615) 00002000:00010000:2.0:1784045403.227003:0:8417:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939cbf610380. 00000100:00100000:3.0:1784045403.325214:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045403.325394:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863297792 00000100:00100000:0.0:1784045403.325405:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863297792 00000100:00100000:0.0:1784045403.325686:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 102 00000100:00100000:0.0:1784045403.325699:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:11330:x1870706863297792:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:0.0:1784045403.325774:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454ccd4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.325790:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454ccd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.325802:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454ccd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.325819:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.325826:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.325833:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.325930:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cce2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.325941:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cce2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.325947:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cce2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045403.326204:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cce2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.326217:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454ccd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.326224:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454ccd4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.326231:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454ccd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.326238:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045403.326242:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454ccd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.326251:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454ccd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.326264:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:0.0:1784045403.326268:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045403.326273:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454ccd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.326388:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454ccd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.326404:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.326410:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.326416:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.326422:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045403.326425:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.326431:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.326440:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939cb5a70800) 00000100:00100000:1.0:1784045403.327246:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.327291:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.327323:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.327345:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.327378:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.327471:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863297920 00000100:00100000:2.0:1784045403.327480:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863297920 00000100:00100000:2.0:1784045403.327540:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 383 00000100:00100000:2.0:1784045403.327550:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2397:x1870706863297920:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045403.327621:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2397:x1870706863297920:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 72us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.327628:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 383 00010000:00010000:0.0:1784045403.327657:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045403.327664:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccdb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045403.327673:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863298176 00010000:00010000:0.0:1784045403.327673:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045403.327676:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863298176 00010000:00010000:0.0:1784045403.327698:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cce2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.327704:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cce2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.327718:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cce2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.327724:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045403.327727:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cce2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045403.327731:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 144 00010000:00010000:0.0:1784045403.327735:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cce2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045403.327737:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863298176:12345-192.168.203.44@tcp:400:kworker.0 00010000:00010000:0.0:1784045403.327749:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:0.0:1784045403.327751:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045403.327754:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cce2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.327760:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cce2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045403.327764:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863298176:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.327770:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 144 00000100:00100000:2.0:1784045403.327785:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863298048 00000100:00100000:2.0:1784045403.327788:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863298048 00000100:00100000:0.0:1784045403.327798:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:11330:x1870706863297792:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 2104us (2594us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045403.327805:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 102 00000100:00100000:2.0:1784045403.327813:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863298304 00000100:00100000:2.0:1784045403.327816:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863298304 00000100:00100000:0.0:1784045403.327816:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863298432 00000100:00100000:0.0:1784045403.327818:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863298432 00000100:00100000:2.0:1784045403.327829:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 299 00000100:00100000:2.0:1784045403.327834:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863298048:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045403.328038:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863298048:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 203us (747us total) trans 0 rc 0/0 00000100:00080000:1.0:1784045403.328108:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045403.328112:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784045403.328114:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784045403.328862:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 300 00000100:00100000:0.0:1784045403.328876:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2396:x1870706863298304:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045403.328944:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2396:x1870706863298304:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 73us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045403.328950:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 300 00000100:00100000:0.0:1784045403.328985:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 301 00000100:00100000:0.0:1784045403.328993:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863298432:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045403.329022:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863298432:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 30us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045403.329037:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 301 00000100:00100000:2.0:1784045403.329847:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 299 00000100:00100000:1.0:1784045403.395258:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045403.395424:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863298688 00000100:00100000:0.0:1784045403.395435:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863298688 00000100:00100000:0.0:1784045403.395543:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 103 00000100:00100000:0.0:1784045403.395557:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:11333:x1870706863298688:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1784045403.395578:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045403.395611:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cce9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73efc6 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.395685:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccf0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.396308:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.396324:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396488:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454ccf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396498:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454ccf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396507:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454ccf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396639:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454ccfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396650:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454ccfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396656:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454ccfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045403.396668:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1784045403.396772:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396780:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccf0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396787:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccf0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396793:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045403.396815:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccf0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396824:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccf0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396838:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:1.0:1784045403.396841:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045403.396847:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccf0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396854:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454ccf0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396870:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454ccf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396877:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454ccf7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396882:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454ccf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396887:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cca00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045403.396890:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454ccf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396895:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454ccf7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396902:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939b81924c00) 00010000:00010000:1.0:1784045403.396904:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045403.396916:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454ccf7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396921:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454ccf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396966:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454cce9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efc6 expref: 33 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396981:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454ccfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efc6 expref: 32 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.396988:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:1.0:1784045403.396990:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784045403.396993:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cd400, rc 0) 00000100:00100000:1.0:1784045403.397258:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+32:11333:x1870706863298688:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1700us (2008us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1784045403.397267:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 103 00000100:00100000:1.0:1784045403.401952:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.404396:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863298816 00000100:00100000:2.0:1784045403.404416:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863298816 00000100:00100000:2.0:1784045403.404593:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 104 00000100:00100000:2.0:1784045403.404604:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+32:11333:x1870706863298816:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:2.0:1784045403.404678:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.404712:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efaa expref: 32 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.404723:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.404765:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efaa expref: 32 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.404779:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efaa expref: 32 pid: 10615 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045403.404793:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf551c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1870706873867264:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045403.405183:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83101cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045403.409224:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.411159:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863299072 00000100:00100000:1.0:1784045403.411174:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863299072 00000100:00100000:1.0:1784045403.411257:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:1.0:1784045403.411268:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+33:6164:x1870706863299072:12345-192.168.203.44@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784045403.411829:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+34:6164:x1870706863299072:12345-192.168.203.44@tcp:35:ldlm_bl.0 Request processed in 561us (2613us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1784045403.411839:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:2.0:1784045403.414027:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf551c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1870706873867264:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045403.414063:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045403.416134:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.416380:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863299200 00000100:00100000:2.0:1784045403.416388:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863299200 00010000:00010000:2.0:1784045403.416429:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efaa expref: 34 pid: 10615 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045403.416498:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:2.0:1784045403.416509:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+34:2394:x1870706863299200:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045403.416526:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045403.416534:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efaa expref: 34 pid: 10615 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.416548:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efaa expref: 34 pid: 10615 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.416574:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cca3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efaa expref: 34 pid: 10615 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.416591:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:2.0:1784045403.416597:0:9500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.416606:0:9500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.416614:0:9500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.416679:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045403.416921:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+33:2394:x1870706863299200:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 412us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.416930:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 66 00010000:00010000:3.0:1784045403.417011:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.417029:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.417068:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.417075:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.417082:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.417088:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045403.417092:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.417110:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.417120:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:3.0:1784045403.417124:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045403.417127:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.417133:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cd0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045403.417176:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+32:11333:x1870706863298816:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 12575us (15235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045403.417185:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 104 00000100:00100000:0.0:1784045403.426843:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045403.426941:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863299456 00000100:00100000:3.0:1784045403.426951:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863299456 00000100:00100000:3.0:1784045403.427061:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:3.0:1784045403.427072:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+32:11333:x1870706863299456:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1784045403.427324:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+33:11333:x1870706863299456:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 253us (491us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1784045403.427332:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:0.0:1784045403.548834:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045403.548990:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863299712 00000100:00100000:3.0:1784045403.549002:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863299712 00000100:00100000:3.0:1784045403.549078:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 105 00000100:00100000:3.0:1784045403.549089:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+33:11344:x1870706863299712:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:3.0:1784045403.549118:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045403.549140:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cd13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73efcd expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549237:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cd1a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549252:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cd1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549264:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cd1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549279:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cd21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549285:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cd21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549292:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cd21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549407:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cd28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549417:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cd28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549424:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cd28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045403.549435:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1784045403.549537:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cd1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549544:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cd1a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549556:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cd1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549562:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fd800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045403.549566:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cd1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549573:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cd1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549584:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:3.0:1784045403.549597:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045403.549601:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cd1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549607:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454cd1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549626:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cd21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549632:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cd21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549637:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cd21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549640:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fda00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045403.549643:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cd21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.549657:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cd21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.550096:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939c93a83400) 00010000:00010000:3.0:1784045403.550099:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045403.550103:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cd21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.550109:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cd21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.550174:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cd13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efcd expref: 36 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.550190:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cd28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efcd expref: 35 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.550197:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:3.0:1784045403.550200:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045403.550202:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93e78e00, rc 0) 00000100:00100000:3.0:1784045403.550325:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+35:11344:x1870706863299712:12345-192.168.203.44@tcp:101:cat.0 Request processed in 1236us (1501us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1784045403.550333:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 105 00000100:00100000:2.0:1784045403.565249:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.565344:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863299968 00000100:00100000:1.0:1784045403.565380:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863299968 00000100:00100000:1.0:1784045403.565438:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:1.0:1784045403.565478:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+35:11344:x1870706863299968:12345-192.168.203.44@tcp:35:cat.0 00000100:00100000:1.0:1784045403.566754:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+36:11344:x1870706863299968:12345-192.168.203.44@tcp:35:cat.0 Request processed in 1262us (1498us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1784045403.566767:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:1.0:1784045403.608005:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045403.614315:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863300224 00000100:00100000:3.0:1784045403.614331:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863300224 00000100:00100000:3.0:1784045403.614563:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 106 00000100:00100000:3.0:1784045403.614575:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+36:11345:x1870706863300224:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:3.0:1784045403.614689:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1784045403.614717:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ccc6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efb8 expref: 36 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.614743:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cd28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efcd expref: 35 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.614757:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454ccfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efc6 expref: 34 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.614770:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454ccb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efb1 expref: 33 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.614781:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:3.0:1784045403.614786:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045403.614808:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cd36 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.614822:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cd36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.614832:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cd36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.614847:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cd3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.614854:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cd3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.614873:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cd3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.614948:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cd44 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.614956:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cd44 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.614963:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cd44 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784045403.615187:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1784045403.615197:0:6497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359723751780ns, next at 360723749512ns, rc = 0 00010000:00010000:3.0:1784045403.615244:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cd4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615254:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cd4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615262:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cd4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615270:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cd4b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615276:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cd4b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615281:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cd4b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615317:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045403.615339:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cd44 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615345:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cd44 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615351:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cd44 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615357:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045403.615369:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cd44 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615377:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cd44 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615386:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:3.0:1784045403.615389:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784045403.615393:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cd44 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615399:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cd44 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615425:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cd36 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615431:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cd36 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615436:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cd36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615499:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045403.615502:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cd36 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615508:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cd36 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615517:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:3.0:1784045403.615519:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045403.615522:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cd36 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615527:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cd36 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045403.615537:0:6497:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f24b3458 reply state 00000000a19e7fbb transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cd3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615548:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cd3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.615553:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939c93a83400) 00010000:00010000:3.0:1784045403.615555:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784045403.615558:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045403.615640:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+34:11345:x1870706863300224:12345-192.168.203.44@tcp:36:rm.0 Request processed in 1066us (7642us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1784045403.615648:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 106 00010000:00010000:1.0:1784045403.617741:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045403.617754:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cd4b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.617765:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fc400 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045403.617769:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cd4b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.617779:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cd4b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.617795:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:1.0:1784045403.617798:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784045403.617802:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cd4b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.617808:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cd4b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.617830:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045403.617832:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045403.617834:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045403.663846:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.663950:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863300480 00000100:00100000:1.0:1784045403.663974:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863300480 00000100:00100000:1.0:1784045403.664046:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 107 00000100:00100000:1.0:1784045403.664056:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+34:11351:x1870706863300480:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:1.0:1784045403.664083:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045403.664105:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454cd52 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73efd4 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.664208:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cd59 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.664223:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cd59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.664235:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cd59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.664245:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cd60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.664251:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cd60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.664258:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cd60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784045403.664655:0:10615:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1784045403.665399:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cd67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.665503:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cd67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.665530:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cd67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.665568:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cd59 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.665574:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cd59 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.665581:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cd59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.665587:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045403.665592:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cd59 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.665599:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cd59 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.665612:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:1.0:1784045403.665615:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045403.665620:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cd59 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.665626:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cd59 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045403.665640:0:10615:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000229d4d5a reply state 00000000f97120b2 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cd60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.665652:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cd60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.666119:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939c93a83400) 00010000:00010000:1.0:1784045403.666122:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784045403.666125:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784045403.666164:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454cd52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efd4 expref: 37 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.666180:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cd67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efd4 expref: 36 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.666187:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b81924c00) 00010000:00010000:1.0:1784045403.666189:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045403.666191:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cda00, rc 0) 00000100:00100000:1.0:1784045403.666275:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+37:11351:x1870706863300480:12345-192.168.203.44@tcp:101:bash.0 Request processed in 2221us (2437us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1784045403.666284:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 107 00000100:00100000:0.0:1784045403.671135:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.673559:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863300608 00000100:00100000:1.0:1784045403.673575:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863300608 00000100:00100000:1.0:1784045403.673646:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:1.0:1784045403.673663:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863300608:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:1.0:1784045403.673682:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045403.673703:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454cd75 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73efdb expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784045403.673728:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784045403.673751:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1784045403.673755:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045403.673782:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454cd75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efdb expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.673805:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454cd75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efdb expref: 6 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.673819:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cce00, rc 0) 00000100:00100000:1.0:1784045403.673888:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863300608:12345-192.168.203.44@tcp:101:bash.0 Request processed in 234us (2764us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045403.673896:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:2.0:1784045403.678771:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.678927:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863300736 00000100:00100000:1.0:1784045403.678938:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863300736 00000100:00100000:1.0:1784045403.678996:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:1.0:1784045403.679005:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:11351:x1870706863300736:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:1.0:1784045403.679021:0:8648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045403.679049:0:8648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73efe2 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.679080:0:8648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454cd75 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efdb expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.679089:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045403.679094:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045403.679099:0:8648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 7 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.679132:0:8648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454cd75 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efdb expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.679160:0:8648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454cd75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efdb expref: 7 pid: 8412 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045403.679174:0:8648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8648:1870706873867392:192.168.203.44@tcp:104: 00000100:00100000:1.0:1784045403.679279:0:8648:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c873eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045403.682932:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.683132:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863300864 00000100:00100000:2.0:1784045403.683141:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863300864 00010000:00010000:2.0:1784045403.683181:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454cd75 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efdb expref: 8 pid: 8412 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045403.683232:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:2.0:1784045403.683242:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2395:x1870706863300864:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045403.683259:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045403.683282:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454cd75 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efdb expref: 8 pid: 8412 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.683296:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454cd75 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efdb expref: 8 pid: 8412 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.683324:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045403.683329:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045403.683338:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 8 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.683380:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 8 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.683427:0:6483:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 8 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045403.683441:0:6483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf552680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6483:1870706873867520:192.168.203.44@tcp:105: 00000100:00100000:2.0:1784045403.683562:0:6483:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83101cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1784045403.686682:0:8648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000099f61d0/0x5475624df454cd75 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efdb expref: 8 pid: 8412 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045403.686705:0:8648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8648:1870706873867392:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045403.686740:0:8648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 7 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045403.686749:0:6483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf552680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6483:1870706873867520:192.168.203.44@tcp:105: 00010000:00010000:1.0:1784045403.686758:0:8648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cc200, rc 0) 00010000:00010000:2.0:1784045403.686767:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045403.686872:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf553b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:11351:x1870706863300736:12345-192.168.203.44@tcp:101:bash.0 Request processed in 7817us (8059us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045403.686880:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:2.0:1784045403.689547:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863300864:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 6294us (6610us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.689563:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:3.0:1784045403.698292:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.698586:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863301120 00000100:00100000:1.0:1784045403.698597:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863301120 00000100:00100000:1.0:1784045403.698665:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:1.0:1784045403.698675:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+37:11351:x1870706863301120:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:1.0:1784045403.698983:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:11351:x1870706863301120:12345-192.168.203.44@tcp:35:bash.0 Request processed in 309us (699us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1784045403.698991:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:2.0:1784045403.795759:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873867904:0@lo:400:kworker.0 00000100:00100000:1.0:1784045403.795759:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873868032:0@lo:400:kworker.0 00000100:00100000:3.0:1784045403.795846:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873867648:0@lo:400:kworker.0 00000100:00100000:0.0:1784045403.795924:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873867776:0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.799244:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045403.799333:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873868416:0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.799393:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045403.799421:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873868928:0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.799442:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045403.799516:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873867904 00000100:00100000:2.0:1784045403.799524:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873867904 00000100:00100000:2.0:1784045403.799572:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784045403.799581:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873867904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.799845:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf552300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873867904:12345-0@lo:400:kworker.0 Request processed in 264us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.799853:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784045403.799893:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873867904:0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.799914:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873868416 00000100:00100000:2.0:1784045403.799917:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873868416 00000100:00080000:2.0:1784045403.799936:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045403.799957:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873868928 00000100:00100000:2.0:1784045403.799959:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873868928 00000100:00080000:2.0:1784045403.799968:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045403.799984:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1784045403.799989:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873868416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.800021:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873868416:12345-0@lo:400:kworker.0 Request processed in 32us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.800026:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1784045403.800037:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1784045403.800043:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873868928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.800068:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873868928:12345-0@lo:400:kworker.0 Request processed in 26us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.800074:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00010000:00080000:2.0:1784045403.800101:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4a4000 x1870706873868416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045403.800111:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873868416:0@lo:400:kworker.0 00010000:00080000:2.0:1784045403.800121:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf546300 x1870706873868928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045403.800142:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873868928:0@lo:400:kworker.0 00000100:00100000:1.0:1784045403.800227:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045403.800264:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873868544:0@lo:400:kworker.0 00000100:00100000:1.0:1784045403.800293:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045403.800315:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873868544 00000100:00100000:1.0:1784045403.800319:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873868544 00000100:00100000:1.0:1784045403.800351:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784045403.800356:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873868544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045403.800401:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873868544:12345-0@lo:400:kworker.0 Request processed in 44us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045403.800407:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784045403.800438:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873868544:0@lo:400:kworker.0 00000100:00100000:1.0:1784045403.800459:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873869056:0@lo:400:kworker.0 00000100:00100000:1.0:1784045403.800480:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045403.800508:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873868032 00000100:00100000:1.0:1784045403.800511:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873868032 00000100:00100000:1.0:1784045403.800528:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1784045403.800534:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873868032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045403.800564:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873868032:12345-0@lo:400:kworker.0 Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045403.800570:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1784045403.800590:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873868032:0@lo:400:kworker.0 00000100:00080000:2.0:1784045403.801017:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045403.801029:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873869056 00000100:00100000:2.0:1784045403.801034:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873869056 00000100:00100000:2.0:1784045403.801069:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784045403.801075:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873869056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.801116:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873869056:12345-0@lo:400:kworker.0 Request processed in 41us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.801122:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1784045403.802941:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045403.802997:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873869056:0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.809404:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045403.809557:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873868160:0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.809620:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045403.809640:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873868672:0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.811623:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045403.811666:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873869184:0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.811709:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045403.812907:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873868160 00000100:00100000:1.0:1784045403.812933:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873868160 00000100:00100000:1.0:1784045403.812997:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784045403.813007:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873868160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045403.813092:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873868160:12345-0@lo:400:kworker.0 Request processed in 87us (3471us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045403.813100:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784045403.813130:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873868672 00000100:00100000:1.0:1784045403.813133:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873868672 00000100:00100000:1.0:1784045403.813162:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873869184 00000100:00100000:1.0:1784045403.813164:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873869184 00000100:00100000:1.0:1784045403.813181:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784045403.813186:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1870706873868672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045403.813213:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1870706873868672:12345-0@lo:400:kworker.0 Request processed in 27us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045403.813219:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784045403.813229:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784045403.813233:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873869184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045403.813252:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf550a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873869184:12345-0@lo:400:kworker.0 Request processed in 19us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045403.813257:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1784045403.813269:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045403.813273:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045403.813418:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873868160:0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.813431:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf545180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873868672:0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.813440:0:3625:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1784045403.813469:0:3625:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1784045403.813492:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939c921f1f80, transno 4294967302 00000100:00100000:2.0:1784045403.813513:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873869184:0@lo:400:kworker.0 00000100:00100000:0.0:1784045403.813716:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045403.813754:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873868288:0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.813757:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873867776 00000100:00100000:2.0:1784045403.813772:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873867776 00000100:00100000:0.0:1784045403.813785:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045403.813802:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873868800:0@lo:400:kworker.0 00000100:00100000:2.0:1784045403.813807:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873868288 00000100:00100000:2.0:1784045403.813811:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873868288 00000100:00100000:0.0:1784045403.813822:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045403.813837:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873868800 00000100:00100000:2.0:1784045403.813841:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873868800 00000100:00100000:0.0:1784045403.813844:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873869312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045403.813864:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1784045403.813871:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045403.813874:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873867776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045403.813904:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873869312 00000100:00100000:0.0:1784045403.813908:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873869312 00000100:00100000:2.0:1784045403.813926:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873867776:12345-0@lo:400:kworker.0 Request processed in 54us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.813934:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1784045403.813938:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784045403.813946:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873869312:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045403.813953:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1784045403.813962:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873868288:12345-0@lo:400:kworker.0 00000004:00000024:0.0:1784045403.813980:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1784045403.813991:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873868288:12345-0@lo:400:kworker.0 Request processed in 30us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.813998:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1784045403.814013:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1784045403.814031:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873868800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784045403.814188:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045403.814860:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873869312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 912us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045403.814870:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784045403.814884:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873868800:12345-0@lo:400:kworker.0 Request processed in 862us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.814892:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1784045403.814930:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873867776:0@lo:400:kworker.0 00000100:00100000:0.0:1784045403.814942:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873868288:0@lo:400:kworker.0 00000100:00100000:0.0:1784045403.814950:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873868800:0@lo:400:kworker.0 00000100:00100000:0.0:1784045403.814963:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873869312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045403.817301:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873867648 00000100:00100000:3.0:1784045403.817622:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873867648 00000100:00100000:3.0:1784045403.817692:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1784045403.817702:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873867648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045403.818157:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873867648:0@lo:400:kworker.0 00000100:00100000:3.0:1784045403.818231:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97797450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873867648:12345-0@lo:400:kworker.0 Request processed in 530us (8834us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045403.818239:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1784045403.884055:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.884201:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863301248 00000100:00100000:1.0:1784045403.884210:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863301248 00000100:00100000:1.0:1784045403.884272:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 108 00000100:00100000:1.0:1784045403.884282:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:11367:x1870706863301248:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1784045403.884321:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045403.884341:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454cd83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73efe9 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.884413:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454cd8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.884428:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454cd8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.884438:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454cd8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045403.884522:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784045403.884526:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784045403.884545:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454cd8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.884568:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454cd83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efe9 expref: 40 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.884587:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454cd8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efe9 expref: 39 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.884595:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:1.0:1784045403.884598:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045403.884601:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cd400, rc 0) 00000100:00100000:1.0:1784045403.884902:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+39:11367:x1870706863301248:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 620us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045403.884910:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 108 00000100:00100000:0.0:1784045403.889805:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.889904:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863301504 00000100:00100000:2.0:1784045403.889914:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863301504 00000100:00100000:2.0:1784045403.890480:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 109 00000100:00100000:2.0:1784045403.890493:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+39:11367:x1870706863301504:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045403.890514:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045403.890535:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cd91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eff0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.890669:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cd98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.890684:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cd98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.890695:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cd98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045403.890706:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784045403.890804:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cd91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eff0 expref: 42 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.890823:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cd98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eff0 expref: 41 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.890831:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b81924c00) 00010000:00010000:2.0:1784045403.890834:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045403.890837:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171200, rc 0) 00000100:00100000:2.0:1784045403.890953:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+41:11367:x1870706863301504:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 463us (1158us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1784045403.890961:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 109 00000100:00100000:0.0:1784045403.894881:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045403.894957:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.895153:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863301888 00000100:00100000:1.0:1784045403.895162:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863301888 00000100:00100000:1.0:1784045403.895223:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:1.0:1784045403.895232:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+41:2396:x1870706863301888:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045403.895248:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045403.895273:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cd98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eff0 expref: 41 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.895292:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b81924c00) 00010000:00010000:1.0:1784045403.895297:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045403.895347:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+40:2396:x1870706863301888:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 116us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045403.895354:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:2.0:1784045403.896590:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863301760 00000100:00100000:2.0:1784045403.896601:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863301760 00000100:00100000:2.0:1784045403.896779:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 110 00000100:00100000:2.0:1784045403.896790:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+40:11367:x1870706863301760:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045403.896813:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045403.896847:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454cda6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73eff7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.896945:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.896960:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.897174:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045403.897189:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784045403.897298:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454cda6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eff7 expref: 43 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.897316:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eff7 expref: 42 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.897324:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b81924c00) 00010000:00010000:2.0:1784045403.897327:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784045403.897331:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171600, rc 0) 00000100:00100000:2.0:1784045403.897402:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+42:11367:x1870706863301760:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 615us (2529us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1784045403.897409:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 110 00000100:00100000:0.0:1784045403.904557:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.904750:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863302016 00000100:00100000:2.0:1784045403.904759:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863302016 00000100:00100000:2.0:1784045403.904815:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:2.0:1784045403.904824:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863302016:12345-192.168.203.44@tcp:1:lfs.0 00010000:00010000:2.0:1784045403.904881:0:9935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.904900:0:9935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 6 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.904908:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1784045403.904913:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045403.904918:0:9935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.904957:0:9935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 6 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.904971:0:9935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 6 pid: 8648 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045403.904985:0:9935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf553800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9935:1870706873869440:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045403.905078:0:9935:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b831019c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045403.908618:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.908741:0:9935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf553800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:9935:1870706873869440:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045403.908767:0:9935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045403.908919:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863302144 00000100:00100000:3.0:1784045403.908926:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863302144 00002000:00100000:2.0:1784045403.909033:0:8419:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff939b830f1180 x1870706863302144/t0(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:44/0 lens 504/0 e 0 to 0 dl 1784045414 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045403.909063:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b830f1180 with x1870706863302144 ext(0->8) 00010000:00010000:2.0:1784045403.909071:0:8419:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 7 pid: 8648 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.909083:0:8419:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 7 pid: 8648 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045403.909091:0:8419:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939b830f1180 00000100:00100000:2.0:1784045403.909125:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:2.0:1784045403.909133:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863302144:12345-192.168.203.44@tcp:4:lfs.0 00000100:00100000:2.0:1784045403.910308:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2394:x1870706863302144:12345-192.168.203.44@tcp:4:lfs.0 Request processed in 1166us (1690us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784045403.910319:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1 00002000:00100000:2.0:1784045403.910328:0:8419:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff939b830f1180 x1870706863302144/t4294967303(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:44/0 lens 504/448 e 0 to 0 dl 1784045414 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045403.910339:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b830f1180 with x1870706863302144 ext(0->8) 00010000:00010000:2.0:1784045403.910347:0:8419:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 9 pid: 8648 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.910371:0:8419:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 9 pid: 8648 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045403.910379:0:8419:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939b830f1180 00000100:00100000:0.0:1784045403.913352:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045403.913549:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863302272 00000100:00100000:1.0:1784045403.913558:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863302272 00010000:00010000:1.0:1784045403.913598:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 9 pid: 8648 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045403.913743:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:1.0:1784045403.913754:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe49850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2396:x1870706863302272:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045403.913770:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784045403.913789:0:6481:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1784045403.913793:0:6481:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1784045403 00002000:00010000:1.0:1784045403.913795:0:6481:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1784045403 00002000:00010000:1.0:1784045403.913797:0:6481:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1784045403 00002000:00010000:1.0:1784045403.913799:0:6481:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784045403.913806:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 9 pid: 8648 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.913837:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 9 pid: 8648 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.913861:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027abe02d/0x5475624df454cd7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73efe2 expref: 9 pid: 8648 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.913877:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045403.913882:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045403.913888:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.913897:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.913935:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045403.913995:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe49850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2396:x1870706863302272:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 243us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045403.914002:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 68 00010000:00010000:3.0:1784045403.914099:0:9935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.914109:0:9935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.914127:0:9935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.914135:0:9935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.914141:0:9935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.914147:0:9935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2170200 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045403.914151:0:9935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.914170:0:9935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.914182:0:9935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.914190:0:9935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000769c7492/0x5475624df454cdbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045403.914240:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863302016:12345-192.168.203.44@tcp:1:lfs.0 Request processed in 9416us (9692us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045403.914247:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:0.0:1784045403.916562:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045403.916665:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863302528 00000100:00100000:3.0:1784045403.916674:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863302528 00000100:00100000:3.0:1784045403.916722:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:3.0:1784045403.916731:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9855e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+42:11367:x1870706863302528:12345-192.168.203.44@tcp:35:lfs.0 00000004:00010000:3.0:1784045403.916794:0:6499:0:(mdt_open.c:1993:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eff7 expref: 42 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045403.916991:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1784045403.917038:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1784045403.917372:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1784045403.917412:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.917427:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cd67 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efd4 expref: 46 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.917472:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.917508:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cd67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efd4 expref: 46 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.917521:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cd67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efd4 expref: 46 pid: 10615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045403.917535:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1870706873869568:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045403.917613:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b81096f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784045403.920795:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045403.920927:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1870706873869568:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045403.920957:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045403.921830:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863302656 00000100:00100000:2.0:1784045403.921854:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863302656 00010000:00010000:2.0:1784045403.921893:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cd67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efd4 expref: 47 pid: 10615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045403.921946:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:1.0:1784045403.921956:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+47:2395:x1870706863302656:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045403.921980:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045403.921987:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cd67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efd4 expref: 47 pid: 10615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.922000:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cd67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efd4 expref: 47 pid: 10615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.922039:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cd67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73efd4 expref: 47 pid: 10615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.922055:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b81924c00) 00010000:00010000:1.0:1784045403.922061:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.922071:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.922078:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045403.922108:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045403.922158:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+46:2395:x1870706863302656:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 203us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045403.922166:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 69 00010000:00010000:0.0:1784045403.922339:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045403.922349:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784045403.922504:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1784045403.922638:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1784045403.922725:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b830f0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1870706873869696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784045403.922777:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045403.922809:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff939ca0090180 going to sleep for 11 seconds 00000100:00100000:3.0:1784045403.923555:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873869696 00000100:00100000:3.0:1784045403.923563:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873869696 00000100:00100000:3.0:1784045403.923603:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784045403.923611:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6499:x1870706873869696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784045403.923834:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6499:x1870706873869696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 224us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045403.923842:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784045403.923921:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b830f0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1870706873869696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784045403.924086:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1784045403.924142:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b830f0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1870706873869824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784045403.924174:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045403.924206:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c91b93d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045403.924376:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873869824 00000100:00100000:3.0:1784045403.924383:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873869824 00000100:00100000:3.0:1784045403.924416:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784045403.924423:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6499:x1870706873869824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784045403.924558:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6499:x1870706873869824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 135us (383us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1784045403.924564:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784045403.924593:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b830f0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1870706873869824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784045403.924637:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1784045403.924668:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.924677:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.924685:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.924691:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fda00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045403.924696:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.924702:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.924716:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b81924c00) 00010000:00010000:3.0:1784045403.924719:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784045403.924723:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045403.924730:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cdc2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784045403.924808:0:6499:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784045403.924873:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1784045403.924884:0:6499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360033438514ns, next at 361033436443ns, rc = 0 00000001:00080000:3.0:1784045403.924890:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1784045403.924910:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b81924c00) 00010000:00010000:3.0:1784045403.924913:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784045403.924920:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdad lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eff7 expref: 50 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045403.925169:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9855e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+49:11367:x1870706863302528:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 8438us (8614us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1784045403.925178:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 26 00000020:00080000:3.0:1784045403.925182:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1784045403.927565:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045403.927828:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863302784 00000100:00100000:2.0:1784045403.927837:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863302784 00000100:00100000:2.0:1784045403.927894:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 111 00000100:00100000:2.0:1784045403.927904:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+49:11367:x1870706863302784:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045403.927927:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045403.927952:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454cdc9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73effe expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.928015:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454cdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73effe expref: 50 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.929168:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454cdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73effe expref: 50 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045403.929197:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:2.0:1784045403.929201:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045403.929204:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2170a00, rc 0) 00000100:00100000:2.0:1784045403.929271:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+50:11367:x1870706863302784:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1368us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045403.929279:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 111 00000100:00100000:3.0:1784045403.932422:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045403.932673:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863303040 00000100:00100000:0.0:1784045403.932682:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863303040 00000100:00100000:0.0:1784045403.932732:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:0.0:1784045403.932742:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+50:11367:x1870706863303040:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1784045403.933140:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+51:11367:x1870706863303040:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 397us (725us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1784045403.933150:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:3.0:1784045404.008789:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045404.008917:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863303168 00000100:00100000:1.0:1784045404.008927:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863303168 00000100:00100000:1.0:1784045404.008992:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 112 00000100:00100000:1.0:1784045404.009002:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+51:11377:x1870706863303168:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:1.0:1784045404.009083:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cdd0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009101:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cdd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009114:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cdd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009146:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cdd7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009153:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009159:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009239:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454cdde lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009248:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454cdde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009253:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454cdde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045404.009308:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454cdde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009324:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cdd0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009330:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cdd0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009336:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cdd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009343:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cda00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045404.009348:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cdd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009375:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cdd0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009390:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:1.0:1784045404.009394:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045404.009398:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cdd0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009405:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cdd0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009420:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009426:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cdd7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009433:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009439:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045404.009442:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009521:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cdd7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009529:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939c93a83400) 00010000:00010000:1.0:1784045404.009532:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045404.009535:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cdd7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009549:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454cdd7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009560:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454cdde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009565:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454cdde lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009571:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454cdde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009576:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045404.009579:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454cdde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009585:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454cdde lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009593:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:1.0:1784045404.009595:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045404.009598:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454cdde lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.009603:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454cdde lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045404.009676:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+51:11377:x1870706863303168:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 674us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045404.009684:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 112 00000100:00100000:0.0:1784045404.072822:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045404.072950:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863303424 00000100:00100000:2.0:1784045404.072959:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863303424 00000100:00100000:2.0:1784045404.073041:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 113 00000100:00100000:2.0:1784045404.073050:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+51:11380:x1870706863303424:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045404.073078:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045404.073102:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cde5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f005 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073171:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cdec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073186:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cdec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073196:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cdec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073207:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073214:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073220:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073380:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cdfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073389:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cdfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073396:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cdfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045404.073405:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784045404.073553:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cdec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073561:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cdec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073567:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cdec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073572:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045404.073577:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cdec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073583:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cdec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073593:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:2.0:1784045404.073597:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045404.073600:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cdec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073605:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454cdec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073619:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073625:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdf3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073631:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073635:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045404.073658:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073664:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdf3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073671:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939c93a83400) 00010000:00010000:2.0:1784045404.073673:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045404.073676:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdf3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073680:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454cdf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073714:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454cde5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f005 expref: 54 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073726:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cdfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f005 expref: 53 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.073733:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:2.0:1784045404.073735:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045404.073737:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2170200, rc 0) 00000100:00100000:2.0:1784045404.073807:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+53:11380:x1870706863303424:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 757us (994us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1784045404.073815:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 113 00000100:00100000:0.0:1784045404.082406:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045404.084147:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863303552 00000100:00100000:1.0:1784045404.084161:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863303552 00000100:00100000:1.0:1784045404.084235:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 114 00000100:00100000:1.0:1784045404.084244:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+53:11380:x1870706863303552:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:1.0:1784045404.084319:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454ce08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.084338:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454ce08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.084351:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454ce08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.084402:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454ce08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.084409:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454ce08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.084416:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454ce08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.084423:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045404.084427:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454ce08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.084436:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454ce08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.084504:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:1.0:1784045404.084508:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045404.084528:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454ce08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.084537:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454ce08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045404.084614:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+53:11380:x1870706863303552:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 370us (2217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045404.084706:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 114 00000100:00100000:3.0:1784045404.090146:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045404.090335:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863303808 00000100:00100000:0.0:1784045404.090344:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863303808 00000100:00100000:0.0:1784045404.090424:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:0.0:1784045404.090433:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+53:11380:x1870706863303808:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1784045404.090861:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+54:11380:x1870706863303808:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 428us (723us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1784045404.090869:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 28 00010000:00010000:1.0:1784045404.115914:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045404.196654:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045404.196757:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863304064 00000100:00100000:2.0:1784045404.196767:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863304064 00000100:00100000:2.0:1784045404.196825:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 115 00000100:00100000:2.0:1784045404.196835:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+54:11390:x1870706863304064:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1784045404.196872:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045404.196876:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784045404.196901:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454cd8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efe9 expref: 54 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.196921:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:2.0:1784045404.196926:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045404.196939:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce0f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f00c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.197274:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.197288:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.197298:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045404.197308:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784045404.197426:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce0f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f00c expref: 56 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.197441:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f00c expref: 55 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.197501:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:2.0:1784045404.197503:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045404.197506:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171600, rc 0) 00000100:00100000:2.0:1784045404.197620:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+55:11390:x1870706863304064:12345-192.168.203.44@tcp:101:bash.0 Request processed in 785us (974us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1784045404.197626:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 115 00000100:00100000:3.0:1784045404.201574:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045404.201922:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863304192 00000100:00100000:2.0:1784045404.201931:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863304192 00000100:00100000:2.0:1784045404.201992:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 116 00000100:00100000:2.0:1784045404.202001:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+55:11390:x1870706863304192:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1784045404.202032:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045404.202054:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ce24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f013 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.202086:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454ce2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.202100:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454ce2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.202110:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454ce2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.202225:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ce24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f013 expref: 57 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.202242:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454ce2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f013 expref: 56 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.202251:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:2.0:1784045404.202254:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784045404.202257:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171200, rc 0) 00000100:00100000:2.0:1784045404.202326:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+56:11390:x1870706863304192:12345-192.168.203.44@tcp:101:bash.0 Request processed in 326us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045404.202333:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 116 00000100:00100000:3.0:1784045404.205880:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045404.206052:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863304448 00000100:00100000:1.0:1784045404.206062:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863304448 00000100:00100000:1.0:1784045404.206121:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 117 00000100:00100000:1.0:1784045404.206130:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+56:11390:x1870706863304448:12345-192.168.203.44@tcp:36:bash.0 00010000:00010000:1.0:1784045404.206182:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045404.206209:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cdfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f005 expref: 56 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.206230:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:1.0:1784045404.206235:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045404.206414:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.206428:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce16 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f00c expref: 56 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.206437:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.206520:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f00c expref: 56 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.206548:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f00c expref: 56 pid: 6498 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045404.206577:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873869952:192.168.203.44@tcp:104: 00000100:00100000:1.0:1784045404.206660:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a7a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045404.209489:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873869952:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045404.209516:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045404.209842:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045404.210141:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863304576 00000100:00100000:1.0:1784045404.210148:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863304576 00010000:00010000:1.0:1784045404.210183:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f00c expref: 57 pid: 6498 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045404.210222:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:1.0:1784045404.210231:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+57:2397:x1870706863304576:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045404.210247:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045404.210253:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce16 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f00c expref: 57 pid: 6498 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.210265:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f00c expref: 57 pid: 6498 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.210286:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f00c expref: 57 pid: 6498 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.210301:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:1.0:1784045404.210305:0:9500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.210334:0:9500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.210342:0:9500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.210377:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045404.210438:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+56:2397:x1870706863304576:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 207us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045404.210467:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 70 00010000:00010000:3.0:1784045404.210955:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.210965:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045404.211215:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1784045404.211266:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000070c51072 reply state 00000000930c1247 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.211282:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.211300:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:3.0:1784045404.211303:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784045404.211306:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045404.211414:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+57:11390:x1870706863304448:12345-192.168.203.44@tcp:36:bash.0 Request processed in 5283us (5541us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1784045404.211557:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 117 00000020:00080000:3.0:1784045404.211562:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784045404.213958:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045404.214087:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863304704 00000100:00100000:2.0:1784045404.214095:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863304704 00000100:00100000:2.0:1784045404.214147:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 118 00000100:00100000:2.0:1784045404.214157:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+57:11390:x1870706863304704:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1784045404.214176:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045404.214194:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ce39 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f01a expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.214279:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.214292:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.214302:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045404.214328:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784045404.214331:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045404.214347:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.214398:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ce39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f01a expref: 59 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.214433:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f01a expref: 58 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.214441:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:2.0:1784045404.214486:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045404.214490:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171800, rc 0) 00000100:00100000:2.0:1784045404.214546:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+58:11390:x1870706863304704:12345-192.168.203.44@tcp:101:bash.0 Request processed in 390us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045404.214553:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 118 00000100:00100000:0.0:1784045404.217049:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045404.217128:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863304960 00000100:00100000:3.0:1784045404.217137:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863304960 00000100:00100000:3.0:1784045404.217191:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:3.0:1784045404.217200:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+58:11390:x1870706863304960:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:3.0:1784045404.217419:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+59:11390:x1870706863304960:12345-192.168.203.44@tcp:35:bash.0 Request processed in 220us (379us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1784045404.217427:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:0.0:1784045404.309114:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045404.309138:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873870080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045404.309211:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045404.309340:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873870080 00000100:00100000:1.0:1784045404.309349:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873870080 00000100:00100000:1.0:1784045404.309417:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1784045404.309427:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873870080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045404.309472:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045404.309517:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873870080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045404.309523:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784045404.309778:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873870080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045404.310006:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045404.310027:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b835b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873870208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045404.310059:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045404.310193:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873870208 00000100:00100000:3.0:1784045404.310200:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873870208 00000100:00100000:3.0:1784045404.310235:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784045404.310243:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873870208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784045404.310255:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045404.310296:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873870208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045404.310302:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784045404.310465:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b835b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873870208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045404.311308:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045404.311392:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863305088 00000100:00100000:2.0:1784045404.311399:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863305088 00000100:00100000:2.0:1784045404.311464:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 119 00000100:00100000:2.0:1784045404.311474:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+59:11397:x1870706863305088:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045404.311496:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045404.311517:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ce47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f021 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.311588:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454ce4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.311604:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454ce4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.311814:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454ce4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045404.311861:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1784045404.311864:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045404.311883:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454ce4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.311907:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454ce47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f021 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.311925:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454ce4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f021 expref: 60 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.311934:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:2.0:1784045404.311937:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045404.311940:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2170200, rc 0) 00000100:00100000:2.0:1784045404.312000:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:11397:x1870706863305088:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 528us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045404.312006:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 119 00000100:00100000:2.0:1784045404.320806:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045404.321000:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863305216 00000100:00100000:1.0:1784045404.321010:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863305216 00000100:00100000:1.0:1784045404.321079:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 120 00000100:00100000:1.0:1784045404.321089:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:11397:x1870706863305216:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1784045404.321109:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045404.321129:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454ce55 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f028 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321211:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ce5c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321227:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ce5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321238:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ce5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321249:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454ce63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321256:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454ce63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321263:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454ce63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321333:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321342:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321349:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045404.321411:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784045404.321415:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784045404.321433:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321496:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321504:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ce5c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321509:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ce5c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321515:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ce5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321521:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cd000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045404.321525:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ce5c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321532:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ce5c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321543:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:1.0:1784045404.321546:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045404.321550:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ce5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321557:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ce5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321572:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454ce63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321579:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454ce63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321590:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454ce63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321595:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045404.321597:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454ce63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321603:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454ce63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321610:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939c93a83400) 00010000:00010000:1.0:1784045404.321613:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045404.321824:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454ce63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321832:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454ce63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321862:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454ce55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f028 expref: 62 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321874:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f028 expref: 61 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.321880:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:1.0:1784045404.321882:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045404.321884:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cdc00, rc 0) 00000100:00100000:1.0:1784045404.321951:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+61:11397:x1870706863305216:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 864us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045404.321968:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 120 00000100:00100000:0.0:1784045404.328598:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045404.328649:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045404.328722:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863305600 00000100:00100000:1.0:1784045404.328731:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863305600 00000100:00100000:1.0:1784045404.328801:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:1.0:1784045404.328810:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+61:2396:x1870706863305600:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045404.328825:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045404.328847:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f028 expref: 61 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.328864:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:1.0:1784045404.328869:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045404.328931:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:2396:x1870706863305600:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 112us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045404.328938:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:3.0:1784045404.329949:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863305472 00000100:00100000:3.0:1784045404.329959:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863305472 00000100:00100000:3.0:1784045404.330008:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 121 00000100:00100000:3.0:1784045404.330034:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:11397:x1870706863305472:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045404.330051:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045404.330069:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454ce71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f02f expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.330173:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.330187:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f01a expref: 61 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.330196:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.330230:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f01a expref: 61 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.330243:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f01a expref: 61 pid: 10615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045404.330257:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b835b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873870336:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045404.330342:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b81096300 going to sleep for 11 seconds 00000100:00100000:3.0:1784045404.335934:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b835b6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873870336:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045404.335963:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045404.340157:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045404.340387:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863305728 00000100:00100000:1.0:1784045404.340397:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863305728 00010000:00010000:1.0:1784045404.340435:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f01a expref: 62 pid: 10615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045404.340516:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 71 00000100:00100000:1.0:1784045404.340526:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+62:2395:x1870706863305728:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045404.340543:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045404.340550:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f01a expref: 62 pid: 10615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.340564:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f01a expref: 62 pid: 10615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.340604:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ce40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f01a expref: 62 pid: 10615 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.340631:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:1.0:1784045404.340637:0:9500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.340647:0:9500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.340655:0:9500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.340681:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045404.340730:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+61:2395:x1870706863305728:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 206us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045404.340974:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 71 00010000:00010000:3.0:1784045404.341310:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.341333:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045404.341352:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784045404.341542:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454ce71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f02f expref: 62 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.341562:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f02f expref: 61 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045404.341571:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:3.0:1784045404.341575:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784045404.341578:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fd800, rc 0) 00000100:00100000:3.0:1784045404.341916:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+61:11397:x1870706863305472:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 11883us (13325us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1784045404.341924:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 121 00000100:00100000:2.0:1784045404.349704:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045404.349837:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863305984 00000100:00100000:1.0:1784045404.349846:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863305984 00000100:00100000:1.0:1784045404.349908:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:1.0:1784045404.349918:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+61:11397:x1870706863305984:12345-192.168.203.44@tcp:103:lfs.0 00010000:00010000:1.0:1784045404.349934:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045404.349958:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454cdc9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73effe expref: 61 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.349978:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:1.0:1784045404.349983:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045404.350066:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf552680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:11397:x1870706863305984:12345-192.168.203.44@tcp:103:lfs.0 Request processed in 150us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045404.350075:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:0.0:1784045404.352098:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045404.352268:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863306112 00000100:00100000:1.0:1784045404.352278:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863306112 00000100:00100000:1.0:1784045404.352326:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 122 00000100:00100000:1.0:1784045404.352335:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:11397:x1870706863306112:12345-192.168.203.44@tcp:58:lfs.0 00010000:00010000:1.0:1784045404.352502:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce86 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.352519:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045404.352530:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784045404.352645:0:10615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1784045404.352720:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:11397:x1870706863306112:12345-192.168.203.44@tcp:58:lfs.0 Request processed in 385us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045404.352728:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 122 00000100:00100000:3.0:1784045404.355784:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045404.355957:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863306240 00000100:00100000:2.0:1784045404.355966:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863306240 00000100:00100000:2.0:1784045404.356028:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 123 00000100:00100000:2.0:1784045404.356037:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:11397:x1870706863306240:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045404.356073:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045404.356093:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f036 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.356140:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce86 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.356151:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce8d lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f036 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.356169:0:6498:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.356181:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce8d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f036 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.356193:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:2.0:1784045404.356197:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045404.356200:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce8d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f036 expref: 61 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045404.356208:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171600, rc 0) 00000100:00100000:2.0:1784045404.356265:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+61:11397:x1870706863306240:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 229us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045404.356271:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 123 00000040:00080000:3.0:1784045405.012377:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784045405.012386:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784045405.012432:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1784045405.012461:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784045405.012602:0:13774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b835b5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1870706873870464:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784045405.012774:0:13774:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b810960c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045405.024378:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045405.024503:0:13774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b835b5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1870706873870464:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784045405.025591:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863306368 00000100:00100000:2.0:1784045405.025599:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863306368 00000100:00100000:2.0:1784045405.025683:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 124 00000100:00100000:2.0:1784045405.025708:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+61:11398:x1870706863306368:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784045405.025738:0:6497:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784045405.025849:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+61:11398:x1870706863306368:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 143us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045405.025857:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 124 00000100:00080000:1.0:1784045405.026526:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045405.030981:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045405.031149:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863306496 00000100:00100000:0.0:1784045405.031158:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863306496 00000100:00100000:0.0:1784045405.031225:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 125 00000100:00100000:0.0:1784045405.031235:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+61:11398:x1870706863306496:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784045405.031306:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ce94 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031323:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ce94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031371:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ce94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031388:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454ce9b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031396:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454ce9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031402:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454ce9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031424:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cea2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031433:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cea2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031439:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cea2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045405.031513:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784045405.031518:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784045405.031530:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cea2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031540:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ce94 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031547:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ce94 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031564:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ce94 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031579:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045405.031583:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ce94 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031590:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ce94 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031600:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c813ee300) 00010000:00010000:0.0:1784045405.031603:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045405.031608:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ce94 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031614:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ce94 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031627:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454ce9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031632:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454ce9b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031638:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454ce9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031644:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045405.031646:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454ce9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031664:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454ce9b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031672:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff939cb5a70800) 00010000:00010000:0.0:1784045405.031674:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045405.031677:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454ce9b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031682:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454ce9b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031696:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cea2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031702:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cea2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031706:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cea2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031711:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045405.031713:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cea2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031718:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cea2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.031724:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:0.0:1784045405.031726:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045405.031729:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cea2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.032317:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454cea2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045405.032983:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+61:11398:x1870706863306496:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 Request processed in 1738us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045405.032994:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 125 00000100:00100000:0.0:1784045405.044237:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045405.044628:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863306752 00000100:00100000:2.0:1784045405.044639:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863306752 00000100:00100000:2.0:1784045405.044805:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 126 00000100:00100000:2.0:1784045405.044816:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+61:11398:x1870706863306752:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045405.044837:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045405.044857:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454cea9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f03d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.044955:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ceb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.044969:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ceb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.044980:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ceb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045405.044990:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1784045405.045058:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ceb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.045065:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ceb0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.045091:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ceb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.045097:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045405.045101:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ceb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.045108:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ceb0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.045120:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:2.0:1784045405.045129:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784045405.045133:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ceb0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.045140:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454ceb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.045177:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454cea9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f03d expref: 63 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.045186:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c813ee300) 00010000:00010000:2.0:1784045405.045189:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045405.045192:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454cea9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f03d expref: 63 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.045201:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2170a00, rc 0) 00000100:00100000:2.0:1784045405.045260:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+62:11398:x1870706863306752:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 446us (1031us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1784045405.045293:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 126 00000100:00100000:2.0:1784045405.054051:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045405.054186:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863306880 00000100:00100000:3.0:1784045405.054196:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863306880 00000100:00100000:3.0:1784045405.054331:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 127 00000100:00100000:3.0:1784045405.054365:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+62:11398:x1870706863306880:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784045405.054411:0:6496:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784045405.054582:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf544e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+62:11398:x1870706863306880:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 227us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045405.054590:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 127 00000100:00100000:1.0:1784045405.058698:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045405.058781:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863307136 00000100:00100000:3.0:1784045405.058791:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863307136 00000100:00100000:3.0:1784045405.058854:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 128 00000100:00100000:3.0:1784045405.058864:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+62:11398:x1870706863307136:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045405.058884:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045405.058887:0:10615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784045405.058959:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454ce4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f021 expref: 62 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.058981:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:3.0:1784045405.058987:0:10615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045405.059000:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cebe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f044 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784045405.059622:0:10615:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1784045405.059885:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cec5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.059900:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.059911:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.059979:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cebe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f044 expref: 64 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.059996:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f044 expref: 63 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.060004:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83200) 00010000:00010000:3.0:1784045405.060007:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045405.060009:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fc400, rc 0) 00000100:00100000:3.0:1784045405.060068:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+63:11398:x1870706863307136:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1206us (1379us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1784045405.060076:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 128 00000100:00100000:1.0:1784045405.064810:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045405.065173:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863307392 00000100:00100000:0.0:1784045405.065184:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863307392 00000100:00100000:0.0:1784045405.065327:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 129 00000100:00100000:0.0:1784045405.065337:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+63:11398:x1870706863307392:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784045405.065406:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045405.065432:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fc400/0x5475624df454cec5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f044 expref: 63 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.065494:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83200) 00010000:00010000:0.0:1784045405.065516:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045405.065539:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ced3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.065553:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ced3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.065562:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ced3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.069556:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ceda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xd95d41a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.069855:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ceda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd95d41a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.069869:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ceda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd95d41a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070133:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ced3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070141:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ced3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070148:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ced3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070154:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045405.070158:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ced3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070166:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ced3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070179:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:1.0:1784045405.070182:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045405.070186:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ced3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070191:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454ced3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070206:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ceda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd95d41a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070212:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ceda lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd95d41a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070217:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ceda lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd95d41a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070295:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cd000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045405.070298:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ceda lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd95d41a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070305:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ceda lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd95d41a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070313:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xd95d41a8 (ffff939b81924300) 00010000:00010000:1.0:1784045405.070316:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045405.070318:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ceda lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd95d41a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.070323:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454ceda lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd95d41a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045405.070525:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+62:11398:x1870706863307392:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 5185us (5791us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784045405.070534:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 129 00000100:00100000:0.0:1784045405.077789:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045405.078251:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863307520 00000100:00100000:3.0:1784045405.078261:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863307520 00000100:00100000:3.0:1784045405.078321:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 130 00000100:00100000:3.0:1784045405.078331:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+62:11398:x1870706863307520:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045405.078350:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045405.078383:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cee1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f04b expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.078419:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cee8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.078431:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.078463:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.078590:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fda00/0x5475624df454cee1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f04b expref: 64 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.078607:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cee8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f04b expref: 63 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.078625:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83b00) 00010000:00010000:3.0:1784045405.078627:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784045405.078630:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93e78400, rc 0) 00000100:00100000:3.0:1784045405.078685:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+63:11398:x1870706863307520:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 355us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045405.078692:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 130 00000100:00100000:3.0:1784045405.082363:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045405.084211:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863307776 00000100:00100000:0.0:1784045405.084252:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863307776 00000100:00100000:0.0:1784045405.084317:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 131 00000100:00100000:0.0:1784045405.084328:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+63:11398:x1870706863307776:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784045405.084428:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454ceef lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.084471:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454ceef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.084484:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454ceef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045405.084974:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1784045405.084987:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361193542031ns, next at 362193538161ns, rc = 0 00000004:00010000:0.0:1784045405.085216:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c7adb9c5 reply state 00000000bb0ea449 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454ceef lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.085232:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454ceef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.085240:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83b00) 00010000:00010000:0.0:1784045405.085243:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784045405.085246:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045405.085419:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:11398:x1870706863307776:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 1091us (3071us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1784045405.085428:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 131 00000100:00100000:3.0:1784045405.091992:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045405.092112:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863307904 00000100:00100000:1.0:1784045405.092121:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863307904 00000100:00100000:1.0:1784045405.092180:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 132 00000100:00100000:1.0:1784045405.092189:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:11398:x1870706863307904:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045405.092211:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045405.092240:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454cef6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f052 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.092294:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454cef6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f052 expref: 66 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.092337:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454cef6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f052 expref: 66 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.092366:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83b00) 00010000:00010000:1.0:1784045405.092369:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045405.092372:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cd000, rc 0) 00000100:00100000:1.0:1784045405.092424:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+66:11398:x1870706863307904:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 236us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045405.092431:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 132 00000100:00100000:3.0:1784045405.096595:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045405.096969:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863308032 00000100:00100000:1.0:1784045405.096979:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863308032 00000100:00100000:1.0:1784045405.097064:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:1.0:1784045405.097074:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2394:x1870706863308032:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784045405.097302:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2394:x1870706863308032:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 229us (716us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1784045405.097311:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00080000:2.0:1784045405.098211:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045405.100829:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045405.101029:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863308288 00000100:00100000:3.0:1784045405.101038:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863308288 00000100:00100000:3.0:1784045405.101098:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:3.0:1784045405.101108:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+66:11398:x1870706863308288:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784045405.101335:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:11398:x1870706863308288:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 226us (513us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1784045405.101344:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:0.0:1784045405.105200:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045405.105360:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863308544 00000100:00100000:3.0:1784045405.105370:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863308544 00000100:00100000:3.0:1784045405.105434:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 133 00000100:00100000:3.0:1784045405.105481:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:11398:x1870706863308544:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784045405.105629:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:11398:x1870706863308544:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 186us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045405.105638:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 133 00000100:00100000:1.0:1784045405.109160:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045405.109261:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863308672 00000100:00100000:3.0:1784045405.109272:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863308672 00000100:00100000:3.0:1784045405.109332:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 134 00000100:00100000:3.0:1784045405.109343:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:11398:x1870706863308672:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045405.109371:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045405.109394:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cefd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f059 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.109504:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.109519:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.109531:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045405.109589:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784045405.109610:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.109910:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cefd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f059 expref: 69 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.109941:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f059 expref: 68 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.110082:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83b00) 00010000:00010000:3.0:1784045405.110087:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784045405.110091:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93e78e00, rc 0) 00000100:00100000:2.0:1784045405.110223:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+68:11398:x1870706863308672:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 875us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045405.110232:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 134 00000100:00100000:1.0:1784045405.115641:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045405.115878:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863308800 00000100:00100000:2.0:1784045405.115888:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863308800 00000100:00100000:2.0:1784045405.115945:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:2.0:1784045405.115956:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2395:x1870706863308800:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045405.115983:0:8648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045405.116003:0:8648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4f04a76/0x5475624df454cf0b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f060 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045405.116035:0:8648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565f5c, blocks: 0x0 00010000:00010000:2.0:1784045405.116055:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1784045405.116060:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045405.116069:0:8648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f04a76/0x5475624df454cf0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f060 expref: 10 pid: 8648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.116089:0:8648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e4f04a76/0x5475624df454cf0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f060 expref: 10 pid: 8648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.116102:0:8648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171800, rc 0) 00000100:00100000:2.0:1784045405.116174:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:2395:x1870706863308800:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 219us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045405.116182:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:0.0:1784045405.120157:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045405.120261:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863309056 00000100:00100000:3.0:1784045405.120271:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863309056 00000100:00100000:3.0:1784045405.120335:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 135 00000100:00100000:3.0:1784045405.120345:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+68:11398:x1870706863309056:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784045405.120499:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+68:11398:x1870706863309056:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 155us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045405.120507:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 135 00000100:00100000:3.0:1784045405.123762:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045405.124023:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863309184 00000100:00100000:2.0:1784045405.124033:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863309184 00000100:00100000:2.0:1784045405.124098:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:2.0:1784045405.124110:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:11398:x1870706863309184:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045405.124128:0:9935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045405.124149:0:9935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038ddb41b/0x5475624df454cf12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f067 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.124188:0:9935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4f04a76/0x5475624df454cf0b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f060 expref: 11 pid: 8648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.124197:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045405.124201:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045405.124207:0:9935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038ddb41b/0x5475624df454cf12 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f067 expref: 11 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.124240:0:9935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e4f04a76/0x5475624df454cf0b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f060 expref: 11 pid: 8648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.124253:0:9935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e4f04a76/0x5475624df454cf0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f060 expref: 11 pid: 8648 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045405.124268:0:9935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf546300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9935:1870706873870592:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045405.124384:0:9935:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83101000 going to sleep for 11 seconds 00000100:00100000:1.0:1784045405.128513:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045405.128625:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863309312 00000100:00100000:3.0:1784045405.128634:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863309312 00010000:00010000:3.0:1784045405.128683:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f04a76/0x5475624df454cf0b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f060 expref: 12 pid: 8648 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045405.128729:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 72 00000100:00100000:3.0:1784045405.128738:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+12:2395:x1870706863309312:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045405.128756:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045405.128779:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e4f04a76/0x5475624df454cf0b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f060 expref: 12 pid: 8648 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.128794:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e4f04a76/0x5475624df454cf0b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f060 expref: 12 pid: 8648 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.128846:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045405.128850:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045405.128859:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000038ddb41b/0x5475624df454cf12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f067 expref: 12 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.128869:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038ddb41b/0x5475624df454cf12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f067 expref: 12 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.128910:0:6483:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000038ddb41b/0x5475624df454cf12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f067 expref: 12 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045405.128925:0:6483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b835b5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6483:1870706873870720:192.168.203.44@tcp:105: 00000100:00100000:3.0:1784045405.129311:0:6483:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b81096480 going to sleep for 11 seconds 00010000:00010000:2.0:1784045405.130534:0:9935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4f04a76/0x5475624df454cf0b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f060 expref: 12 pid: 8648 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045405.130556:0:9935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf546300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9935:1870706873870592:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045405.130590:0:9935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038ddb41b/0x5475624df454cf12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f067 expref: 11 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.130605:0:9935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2170a00, rc 0) 00000100:00100000:2.0:1784045405.130813:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:11398:x1870706863309184:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 6706us (7058us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045405.130822:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:3.0:1784045405.134374:0:6483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b835b5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6483:1870706873870720:192.168.203.44@tcp:105: 00010000:00010000:3.0:1784045405.134401:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045405.134521:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:2395:x1870706863309312:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 5782us (6015us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045405.134532:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 72 00000100:00100000:0.0:1784045405.137329:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045405.137698:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863309440 00000100:00100000:2.0:1784045405.137707:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863309440 00002000:00100000:2.0:1784045405.137757:0:8417:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff939b836bc000 x1870706863309440/t0(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:46/0 lens 504/0 e 0 to 0 dl 1784045416 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045405.137768:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b836bc000 with x1870706863309440 ext(0->12) 00002000:00010000:2.0:1784045405.137774:0:8417:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939b836bc000 00000100:00100000:2.0:1784045405.137799:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:2.0:1784045405.137808:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:2395:x1870706863309440:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784045405.139287:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+12:2395:x1870706863309440:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 Request processed in 1473us (1958us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1784045405.139299:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 2 00002000:00100000:2.0:1784045405.139309:0:8417:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff939b836bc000 x1870706863309440/t4294967309(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:46/0 lens 504/448 e 0 to 0 dl 1784045416 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045405.139329:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b836bc000 with x1870706863309440 ext(0->12) 00002000:00010000:2.0:1784045405.139335:0:8417:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939b836bc000 00010000:00010000:0.0:1784045405.141106:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045405.142073:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045405.142160:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863309568 00000100:00100000:0.0:1784045405.142168:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863309568 00000100:00100000:0.0:1784045405.142251:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 136 00000100:00100000:0.0:1784045405.142261:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+68:11398:x1870706863309568:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784045405.144861:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1784045405.144882:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1784045405.144919:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1784045405.144938:0:6475:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939c91b93900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1784045405.144943:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939b830a7200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff939c92dfc480 00000020:00080000:3.0:1784045405.144947:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939b830a7700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939b833c2000 00000004:00080000:3.0:1784045405.144983:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1784045405.145004:0:6475:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939c9fd81c00 refcount 2 committed 0 result 0 batchid 2 00000100:00100000:0.0:1784045405.145180:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873870976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784045405.145245:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045405.145288:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045405.145294:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873870848:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784045405.145314:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045405.145344:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873870976 00000100:00100000:0.0:1784045405.145366:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873870976 00000100:00100000:0.0:1784045405.145413:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873870848 00000100:00100000:0.0:1784045405.145417:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873870848 00000100:00100000:0.0:1784045405.145434:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784045405.145465:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3626:x1870706873870976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1784045405.145595:0:8648:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784045405.145599:0:8648:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1784045404 00002000:00010000:0.0:1784045405.145602:0:8648:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784045405.145604:0:8648:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1784045404 -> 1784045404 00002000:00010000:0.0:1784045405.145606:0:8648:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1784045405.145715:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3626:x1870706873870976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 272us (469us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784045405.145723:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784045405.145739:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784045405.145746:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3626:x1870706873870848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784045405.145760:0:8648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1784045405.145778:0:8648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.145807:0:8648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba70f9d2/0x5475624df454cccd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.44@tcp remote: 0x204809eba73efbf expref: 11 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.145817:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1784045405.145821:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784045405.145826:0:8648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.145853:0:8648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba70f9d2/0x5475624df454cccd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.44@tcp remote: 0x204809eba73efbf expref: 11 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.145867:0:8648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba70f9d2/0x5475624df454cccd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.44@tcp remote: 0x204809eba73efbf expref: 11 pid: 8411 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045405.145879:0:8648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8648:1870706873871104:192.168.203.44@tcp:104: 00000100:00100000:0.0:1784045405.145932:0:8648:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c99883a80 going to sleep for 11 seconds 00000100:00080000:0.0:1784045405.145945:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1784045405.145975:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939b836bdf80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1784045405.145981:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873870976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784045405.146254:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873871232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784045405.146287:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045405.146320:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873871232 00000100:00100000:1.0:1784045405.146325:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873871232 00000100:00100000:1.0:1784045405.146368:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784045405.146375:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3623:x1870706873871232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784045405.146398:0:9935:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:1.0:1784045405.146421:0:9935:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a565f5b, atime: 0x6a565f5b, ctime: 0x6a565f5b, blocks: 0x8 00010000:00010000:1.0:1784045405.146427:0:9935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454cf20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.146438:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1784045405.146441:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045405.146463:0:9935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454cf20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.146477:0:9935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454cf20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.146487:0:9935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454cf20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.146495:0:9935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454cf20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.146512:0:9935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784045405.146723:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3623:x1870706873871232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 348us (433us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1784045405.146730:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1784045405.146754:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045405.146761:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454cf20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.146782:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045405.146787:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454cf20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.146797:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454cf20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.146814:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454cf20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.146823:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454cf20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.146842:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045405.146844:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045405.146846:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784045405.146853:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1784045405.146878:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939c812afb80/2, rc 0, transno 4294967305 00000100:00100000:1.0:1784045405.146885:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873871232:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1784045405.149923:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cc17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.149940:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cc17 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.149948:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cc17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.149955:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045405.149959:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cc17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.149966:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cc17 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.149993:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff939c93a83f00) 00010000:00010000:2.0:1784045405.149996:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045405.150001:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cc17 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150007:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cc17 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150055:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccbf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150085:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccbf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150091:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150096:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045405.150099:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccbf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150106:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccbf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150115:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff939c93a83c00) 00010000:00010000:2.0:1784045405.150117:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045405.150119:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccbf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150125:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454ccbf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150142:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cd3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150148:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cd3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150153:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cd3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150157:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045405.150165:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cd3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150171:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cd3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150178:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939c93a83400) 00010000:00010000:2.0:1784045405.150181:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045405.150183:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cd3d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150188:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cd3d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150200:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cd60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150206:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cd60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150211:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cd60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150216:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cd600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045405.150219:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cd60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150224:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cd60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150231:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939c93a83400) 00010000:00010000:2.0:1784045405.150233:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045405.150242:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cd60 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150248:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cd60 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150268:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150274:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150280:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150285:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cda00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045405.150288:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150294:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150303:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:2.0:1784045405.150305:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045405.150308:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150313:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454ce32 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150324:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454ceef lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150330:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454ceef lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150342:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454ceef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150347:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045405.150363:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454ceef lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150370:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454ceef lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150379:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83b00) 00010000:00010000:2.0:1784045405.150381:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784045405.150385:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454ceef lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.150391:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454ceef lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1784045405.150520:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1784045405.151209:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939b82023a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff939c9fd81540 00000020:00080000:3.0:1784045405.151213:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939b82023700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939b833b1600 00000020:00080000:0.0:1784045405.151248:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1784045405.151321:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1784045405.151863:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045405.151954:0:8648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8648:1870706873871104:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045405.151986:0:8648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045405.152534:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863309696 00000100:00100000:3.0:1784045405.152543:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863309696 00010000:00010000:3.0:1784045405.152594:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba70f9d2/0x5475624df454cccd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.44@tcp remote: 0x204809eba73efbf expref: 12 pid: 8411 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045405.152639:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 73 00000100:00100000:3.0:1784045405.152648:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+12:2394:x1870706863309696:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045405.152665:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045405.152670:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba70f9d2/0x5475624df454cccd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.44@tcp remote: 0x204809eba73efbf expref: 12 pid: 8411 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.152684:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba70f9d2/0x5475624df454cccd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.44@tcp remote: 0x204809eba73efbf expref: 12 pid: 8411 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.152705:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba70f9d2/0x5475624df454cccd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.44@tcp remote: 0x204809eba73efbf expref: 12 pid: 8411 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.152721:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045405.152725:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045405.152731:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.152760:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.152788:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045405.152838:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:2394:x1870706863309696:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 191us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045405.152846:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 73 00010000:00010000:2.0:1784045405.153134:0:8648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.153144:0:8648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.153165:0:8648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.153173:0:8648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.153190:0:8648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784045405.153337:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3626:x1870706873870848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7589us (8019us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784045405.153345:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:0.0:1784045405.154516:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939b836bf100/2, rc 0, transno 4294967311 00000100:00100000:0.0:1784045405.154527:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873870848:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1784045405.155098:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045405.155107:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.155120:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045405.155124:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.155133:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.155152:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.155159:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cda725c/0x5475624df454cf19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.155182:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045405.155192:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045405.155194:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045405.155864:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:11398:x1870706863309568:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 Request processed in 13600us (13850us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045405.155875:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 136 00000100:00100000:0.0:1784045405.158127:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045405.158250:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863309824 00000100:00100000:1.0:1784045405.158258:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863309824 00000100:00100000:1.0:1784045405.158345:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:1.0:1784045405.158381:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:2394:x1870706863309824:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1784045405.164997:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1784045405.165015:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1784045405.165199:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863309824:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 Request processed in 6815us (7074us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045405.165210:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:0.0:1784045405.168979:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045405.169030:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863310080 00000100:00100000:3.0:1784045405.169041:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863310080 00000100:00100000:3.0:1784045405.169101:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 137 00000100:00100000:3.0:1784045405.169111:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:11398:x1870706863310080:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045405.169163:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045405.169191:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f059 expref: 16 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.169210:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83b00) 00010000:00010000:3.0:1784045405.169215:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045405.169243:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cf27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.169254:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cf27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.169264:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cf27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045405.169435:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006c3a66cb reply state 0000000085343137 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cf27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.169491:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cf27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.169498:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83b00) 00010000:00010000:3.0:1784045405.169515:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784045405.169517:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045405.169616:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:11398:x1870706863310080:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 506us (654us total) trans 4294967403 rc 0/0 00000100:00100000:3.0:1784045405.169623:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 137 00000100:00100000:2.0:1784045405.171668:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045405.171758:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863310208 00000100:00100000:1.0:1784045405.171768:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863310208 00000100:00100000:1.0:1784045405.171904:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:1.0:1784045405.171915:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863310208:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1784045405.172073:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1784045405.172076:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1784045404 -> 1784045403 00002000:00010000:1.0:1784045405.172079:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1784045403 00002000:00010000:1.0:1784045405.172081:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1784045404 -> 1784045403 00002000:00010000:1.0:1784045405.172083:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1784045405.172137:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863310208:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 223us (474us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1784045405.172145:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:1.0:1784045405.175699:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045405.175791:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863310464 00000100:00100000:2.0:1784045405.175800:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863310464 00000100:00100000:2.0:1784045405.175861:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 138 00000100:00100000:2.0:1784045405.175871:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:11398:x1870706863310464:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784045405.175935:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.175952:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cee8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f04b expref: 17 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.175962:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.175997:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cee8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f04b expref: 17 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.176031:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cee8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f04b expref: 17 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045405.176044:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873871360:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045405.177857:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83101b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045405.185878:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045405.185912:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863310592 00000100:00100000:0.0:1784045405.185921:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863310592 00010000:00010000:0.0:1784045405.185958:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cee8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f04b expref: 18 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045405.185996:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 74 00000100:00100000:0.0:1784045405.186006:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:2395:x1870706863310592:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045405.186021:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045405.186028:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cee8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f04b expref: 18 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.186040:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cee8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f04b expref: 18 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.186074:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83b00) 00010000:00010000:0.0:1784045405.186079:0:9500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.186089:0:9500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.186096:0:9500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.186116:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045405.186157:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:2395:x1870706863310592:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 152us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045405.186180:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 74 00010000:00010000:3.0:1784045405.191196:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cee8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f04b expref: 17 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045405.191228:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873871360:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045405.191246:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.191257:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.191263:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.191306:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.191313:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.191319:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.191326:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2170200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045405.191330:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.191376:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.191392:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83b00) 00010000:00010000:3.0:1784045405.191395:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784045405.191400:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.191406:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454cf2e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045405.191663:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:11398:x1870706863310464:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 Request processed in 15791us (15971us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784045405.191674:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 138 00000100:00100000:1.0:1784045405.204777:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045405.204887:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863310720 00000100:00100000:2.0:1784045405.204897:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863310720 00000100:00100000:2.0:1784045405.204962:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:2.0:1784045405.204972:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863310720:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784045405.205015:0:8648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.205036:0:8648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038ddb41b/0x5475624df454cf12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f067 expref: 7 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.205044:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045405.205165:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045405.205171:0:8648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.205207:0:8648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038ddb41b/0x5475624df454cf12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f067 expref: 7 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.205222:0:8648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038ddb41b/0x5475624df454cf12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f067 expref: 7 pid: 9935 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045405.205264:0:8648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8648:1870706873871488:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045405.205349:0:8648:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83101540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045405.217283:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045405.217417:0:8648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8648:1870706873871488:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045405.217492:0:8648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045405.217605:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863310848 00000100:00100000:3.0:1784045405.217613:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863310848 00010000:00010000:3.0:1784045405.217651:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038ddb41b/0x5475624df454cf12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f067 expref: 8 pid: 9935 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045405.217691:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 75 00000100:00100000:3.0:1784045405.217701:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2394:x1870706863310848:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045405.217716:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045405.217735:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038ddb41b/0x5475624df454cf12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f067 expref: 8 pid: 9935 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.217748:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038ddb41b/0x5475624df454cf12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f067 expref: 8 pid: 9935 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.217791:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038ddb41b/0x5475624df454cf12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f067 expref: 8 pid: 9935 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.217810:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045405.217814:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045405.217820:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.217830:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.217861:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045405.218045:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863310848:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 344us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045405.218121:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 75 00010000:00010000:2.0:1784045405.218253:0:8648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.218264:0:8648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.218286:0:8648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.218293:0:8648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.218300:0:8648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.218307:0:8648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171400 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045405.218311:0:8648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.218318:0:8648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.218343:0:8648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.218361:0:8648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025324eec/0x5475624df454cf35 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045405.218412:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863310720:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 Request processed in 13441us (13647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045405.218431:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:0.0:1784045405.221483:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045405.221654:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863311104 00000100:00100000:2.0:1784045405.221665:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863311104 00000100:00100000:2.0:1784045405.221722:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 139 00000100:00100000:2.0:1784045405.221732:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:11398:x1870706863311104:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784045405.221811:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.221829:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454ce2b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f013 expref: 16 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.221839:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.221877:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454ce2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f013 expref: 16 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.221891:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454ce2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f013 expref: 16 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045405.221923:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1870706873871616:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045405.222005:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83101180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045405.225789:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045405.226119:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1870706873871616:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045405.226151:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045405.226904:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863311232 00000100:00100000:0.0:1784045405.226913:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863311232 00010000:00010000:0.0:1784045405.226957:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454ce2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f013 expref: 17 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045405.227015:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 76 00000100:00100000:0.0:1784045405.227024:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:2395:x1870706863311232:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045405.227040:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045405.227047:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454ce2b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f013 expref: 17 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.227185:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454ce2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f013 expref: 17 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.227209:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454ce2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f013 expref: 17 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.227227:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:0.0:1784045405.227233:0:9500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f036 expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.227259:0:9500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.227267:0:9500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.227276:0:9500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.227307:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045405.227380:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:2395:x1870706863311232:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 356us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045405.227388:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 76 00010000:00010000:2.0:1784045405.228217:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.228229:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.228404:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.228419:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454cef6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f052 expref: 16 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.228429:0:6498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.228490:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454cef6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f052 expref: 16 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.228506:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454cef6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f052 expref: 16 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045405.229168:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1870706873871744:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045405.229263:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83101780 going to sleep for 11 seconds 00000100:00100000:1.0:1784045405.233910:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045405.234015:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863311360 00000100:00100000:0.0:1784045405.234024:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863311360 00010000:00010000:0.0:1784045405.234072:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454cef6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f052 expref: 17 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045405.234113:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 77 00000100:00100000:0.0:1784045405.234123:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:2394:x1870706863311360:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045405.234138:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045405.234145:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454cef6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f052 expref: 17 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.234157:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454cef6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f052 expref: 17 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.234201:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83b00) 00010000:00010000:0.0:1784045405.234207:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.234217:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.234224:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.234244:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045405.234302:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:2394:x1870706863311360:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 180us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045405.234310:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 77 00010000:00010000:2.0:1784045405.235325:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454cef6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f052 expref: 16 pid: 10615 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045405.235345:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1870706873871744:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045405.235382:0:6498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.235391:0:6498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.235396:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045405.235557:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1784045405.235683:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1784045405.235716:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1784045405.235791:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6498:1870706873871872:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784045405.235843:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045405.235927:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83101b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045405.237315:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873871872 00000100:00100000:3.0:1784045405.237326:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873871872 00000100:00100000:0.0:1784045405.237634:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784045405.237645:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6498:x1870706873871872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784045405.237762:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6498:x1870706873871872:12345-0@lo:1000:mdt00_002.0 Request processed in 119us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045405.237769:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784045405.237832:0:6498:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1784045405.237838:0:6498:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:2.0:1784045405.237858:0:6498:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939b836bdf80, transno 4294967310 00000004:00080000:2.0:1784045405.237880:0:6498:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939b836bf100, transno 4294967311 00000100:00100000:2.0:1784045405.237888:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6498:1870706873871872:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1784045405.238057:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1784045405.238120:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6498:1870706873872000:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784045405.238155:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045405.239225:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83101840 going to sleep for 11 seconds 00000100:00100000:3.0:1784045405.239298:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873872000 00000100:00100000:3.0:1784045405.239305:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873872000 00000100:00100000:3.0:1784045405.239357:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784045405.239365:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6498:x1870706873872000:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1784045405.239731:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6498:x1870706873872000:12345-0@lo:1000:mdt00_002.0 Request processed in 365us (1573us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1784045405.239739:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784045405.239827:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6498:1870706873872000:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1784045405.239868:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.239879:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.239888:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.239894:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045405.239899:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.239906:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.239923:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83b00) 00010000:00010000:2.0:1784045405.239926:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045405.239931:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.239938:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454cf43 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.239962:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce86 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.239968:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce86 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.239973:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce86 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.239993:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cdc00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045405.239996:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce86 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.240002:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce86 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.240138:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:2.0:1784045405.240142:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045405.240149:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f036 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.240161:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce8d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f036 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.240170:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f036 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045405.240203:0:6498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f036 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045405.240216:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1870706873872128:192.168.203.44@tcp:105: 00000100:00100000:2.0:1784045405.240297:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83101840 going to sleep for 11 seconds 00000100:00100000:3.0:1784045405.243381:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045405.243410:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863311488 00000100:00100000:3.0:1784045405.243429:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863311488 00000100:00100000:3.0:1784045405.243496:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:3.0:1784045405.243505:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:11397:x1870706863311488:12345-192.168.203.44@tcp:49:lfs.0 00000100:00100000:0.0:1784045405.244335:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6498:1870706873872128:192.168.203.44@tcp:105: 00010000:00010000:0.0:1784045405.244371:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce86 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244381:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454ce86 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244415:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454cf4a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244439:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454cf4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244467:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454cf4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244478:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454cf4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244484:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454cf4a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244490:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454cf4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244496:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045405.244500:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454cf4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244507:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454cf4a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244517:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:0.0:1784045405.244530:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045405.244534:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454cf4a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244540:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454cf4a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244550:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244561:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244567:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244572:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2170000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045405.244575:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244581:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244590:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:0.0:1784045405.244592:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784045405.244595:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.244600:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454cf3c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784045405.245251:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045405.245257:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784045405.245793:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1784045405.245801:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784045405.246316:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:11397:x1870706863311488:12345-192.168.203.44@tcp:49:lfs.0 Request processed in 2805us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045405.246329:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:0.0:1784045405.246460:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:11398:x1870706863311104:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 24715us (25001us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1784045405.246469:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 139 00000020:00080000:0.0:1784045405.246473:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1784045405.250846:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045405.250984:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045405.251860:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863311744 00000100:00100000:2.0:1784045405.251870:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863311744 00000100:00100000:0.0:1784045405.251981:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863312000 00000100:00100000:0.0:1784045405.251985:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863312000 00000100:00100000:0.0:1784045405.252055:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 32 00000100:00100000:0.0:1784045405.252066:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9855c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:11398:x1870706863312000:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784045405.252335:0:6500:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784045405.252378:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1784045405.252416:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cf51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.252433:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cf51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045405.252437:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 140 00000100:00100000:1.0:1784045405.252463:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11397:x1870706863311744:12345-192.168.203.44@tcp:58:lfs.0 00000040:00080000:1.0:1784045405.252565:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00010000:00010000:0.0:1784045405.252845:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cf51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.252855:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cf51 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.252861:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cf51 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.252867:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cf51 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045405.252879:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11397:x1870706863311744:12345-192.168.203.44@tcp:58:lfs.0 Request processed in 435us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045405.252887:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 140 00010000:00010000:0.0:1784045405.259826:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045405.260107:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045405.260117:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cf51 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.260128:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2800 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045405.260132:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cf51 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.260142:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cf51 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.260159:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83b00) 00010000:00010000:3.0:1784045405.260162:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784045405.260166:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cf51 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.260173:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454cf51 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.260186:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045405.260188:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045405.260190:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045405.260519:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9855c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:11398:x1870706863312000:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 8450us (9530us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1784045405.260596:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 32 00000020:00080000:0.0:1784045405.260602:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784045405.283405:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045405.283819:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863312128 00000100:00100000:3.0:1784045405.283829:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863312128 00000100:00100000:3.0:1784045405.283924:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 141 00000100:00100000:3.0:1784045405.283935:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:11400:x1870706863312128:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045405.283958:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045405.283979:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cf58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f06e expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.284088:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf5f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.284103:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.284115:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.284132:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cf66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.284139:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cf66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.284145:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cf66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.284215:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cf6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.284226:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f02f expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.284245:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cf6d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.284279:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f02f expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045405.284292:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f02f expref: 22 pid: 6496 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045405.284306:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b835b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873872256:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045405.284407:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b81096240 going to sleep for 11 seconds 00000100:00100000:3.0:1784045405.287902:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045405.288167:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863312384 00000100:00100000:1.0:1784045405.288176:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863312384 00000100:00100000:1.0:1784045405.288234:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:1.0:1784045405.288243:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:6164:x1870706863312384:12345-192.168.203.44@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784045405.289173:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b835b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873872256:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045405.289198:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cf6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045405.289680:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:6164:x1870706863312384:12345-192.168.203.44@tcp:35:ldlm_bl.0 Request processed in 1436us (1784us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1784045405.289691:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:2.0:1784045405.292811:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045405.292907:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863312512 00000100:00100000:0.0:1784045405.292916:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863312512 00010000:00010000:0.0:1784045405.292953:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f02f expref: 24 pid: 6496 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045405.294796:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 78 00000100:00100000:0.0:1784045405.294817:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:2394:x1870706863312512:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045405.294837:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045405.294848:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f02f expref: 24 pid: 6496 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.294865:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f02f expref: 24 pid: 6496 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.294888:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454ce78 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f02f expref: 24 pid: 6496 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.294907:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:0.0:1784045405.294912:0:9500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cf6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.294922:0:9500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cf6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.294929:0:9500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cf6d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045405.294963:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045405.295240:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cf6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.295249:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cf6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045405.295302:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784045405.295307:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784045405.295327:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cf6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.295342:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cf6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.295364:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.295371:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf5f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.295391:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.295398:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045405.295402:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.295409:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf5f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.295419:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:1.0:1784045405.295423:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045405.295426:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.295432:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454cf5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045405.296790:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:2394:x1870706863312512:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 1975us (3981us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045405.296802:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 78 00010000:00010000:1.0:1784045405.296854:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cf66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.296864:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cf66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.296871:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cf66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.296876:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045405.296880:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cf66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.296900:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cf66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.296915:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff939c93a85100) 00010000:00010000:1.0:1784045405.296918:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045405.296922:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cf66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.296929:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454cf66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.296984:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454cf58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f06e expref: 23 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.296998:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cf6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f06e expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045405.297006:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:1.0:1784045405.297008:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045405.297011:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93e78800, rc 0) 00000100:00100000:1.0:1784045405.297039:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11400:x1870706863312128:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 13106us (13643us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045405.297046:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 141 00000040:00080000:1.0:1784045406.115764:0:14290:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045406.115774:0:14290:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784045406.115805:0:14290:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1784045406.115811:0:14290:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1784045406.165741:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784045406.292598:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045406.292613:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784045406.292649:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1784045406.292656:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784045406.292784:0:13774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1870706873872384:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784045406.292882:0:13774:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fcd99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045406.302281:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045406.302307:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863312640 00000100:00100000:2.0:1784045406.302323:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863312640 00000100:00100000:2.0:1784045406.302382:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 142 00000100:00100000:2.0:1784045406.302392:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:11412:x1870706863312640:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784045406.302429:0:10615:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784045406.302549:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:11412:x1870706863312640:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 159us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045406.302557:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 142 00000100:00100000:0.0:1784045406.302733:0:13774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1870706873872384:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784045406.315243:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045406.315313:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863312896 00000100:00100000:0.0:1784045406.315322:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863312896 00000100:00100000:0.0:1784045406.315388:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 143 00000100:00100000:0.0:1784045406.315399:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:11412:x1870706863312896:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045406.315418:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045406.315437:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cf74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f075 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.315709:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cf7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.315724:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cf7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.315736:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cf7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045406.315749:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784045406.315854:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cf74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f075 expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.315870:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cf7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f075 expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.315897:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:0.0:1784045406.315900:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045406.315904:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b3600, rc 0) 00000100:00100000:0.0:1784045406.315998:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:11412:x1870706863312896:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 600us (763us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1784045406.316005:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 143 00000100:00100000:2.0:1784045406.327652:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045406.327696:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045406.327820:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863313152 00000100:00100000:0.0:1784045406.327830:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863313152 00000100:00100000:0.0:1784045406.327885:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 144 00000100:00100000:0.0:1784045406.327896:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:11412:x1870706863313152:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784045406.327974:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cf89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.327992:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cf89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.328003:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cf89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.328200:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cf89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.328208:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cf89 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.328215:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cf89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.328231:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045406.328235:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cf89 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.328242:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cf89 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.328254:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:0.0:1784045406.328257:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784045406.328261:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cf89 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045406.328267:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cf89 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045406.328386:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:11412:x1870706863313152:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 491us (743us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1784045406.328394:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 144 00000040:00080000:0.0:1784045406.328522:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045406.328527:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045406.329036:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1784045406.329046:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784045406.329515:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863313280 00000100:00100000:1.0:1784045406.329524:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863313280 00000100:00100000:1.0:1784045406.329577:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:1.0:1784045406.329586:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:2394:x1870706863313280:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045406.329600:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045406.329633:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454cf7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f075 expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045406.329650:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:1.0:1784045406.329655:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045406.329697:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:2394:x1870706863313280:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 112us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045406.329704:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:3.0:1784045406.331112:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045406.331172:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863313536 00000100:00100000:0.0:1784045406.331180:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863313536 00000100:00100000:0.0:1784045406.331267:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:0.0:1784045406.331277:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:11412:x1870706863313536:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784045406.331514:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:11412:x1870706863313536:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 238us (407us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1784045406.331542:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:2.0:1784045406.870136:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045406.870163:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873872512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045406.870245:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045406.870722:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873872512 00000100:00100000:0.0:1784045406.870730:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873872512 00000100:00100000:0.0:1784045406.870784:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784045406.870793:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873872512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784045406.870816:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1784045406.870865:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873872512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045406.870873:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784045406.870892:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045406.870901:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b835b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873872640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045406.870928:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045406.870961:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873872640 00000100:00100000:0.0:1784045406.870964:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873872640 00000100:00100000:0.0:1784045406.870986:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784045406.870993:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1870706873872640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784045406.871003:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1784045406.871030:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1870706873872640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045406.871036:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784045406.871075:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b835b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873872640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045406.871106:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873872512:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784045406.871325:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784045407.187733:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045407.380233:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045407.380258:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b835b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873872768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045407.380324:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045407.380478:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873872768 00000100:00100000:3.0:1784045407.380486:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873872768 00000100:00100000:3.0:1784045407.380534:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784045407.380543:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873872768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045407.380593:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045407.380658:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873872768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045407.380665:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784045407.380940:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b835b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873872768:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1784045407.950981:0:14342:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045407.950991:0:14342:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045407.951040:0:14342:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1784045407.951048:0:14342:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784045408.182538:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045408.182726:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863313792 00000100:00100000:1.0:1784045408.182736:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863313792 00000100:00100000:1.0:1784045408.182824:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 145 00000100:00100000:1.0:1784045408.182834:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:11433:x1870706863313792:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1784045408.182857:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045408.182879:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cde00/0x5475624df454cf90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f07c expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045408.183005:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454cf97 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045408.183020:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454cf97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045408.183034:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454cf97 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045408.183046:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784045408.183149:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cde00/0x5475624df454cf90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f07c expref: 28 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045408.183165:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454cf97 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f07c expref: 27 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045408.183174:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:1.0:1784045408.183177:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784045408.183180:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cca00, rc 0) 00000100:00100000:1.0:1784045408.183247:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:11433:x1870706863313792:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 414us (717us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1784045408.183254:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 145 00000100:00080000:3.0:1784045408.183724:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045408.188510:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045408.188702:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863313920 00000100:00100000:0.0:1784045408.188712:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863313920 00000100:00100000:0.0:1784045408.188788:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 146 00000100:00100000:0.0:1784045408.188813:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:11433:x1870706863313920:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:0.0:1784045408.188877:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cfa5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045408.188893:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045408.188904:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045408.188939:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cfa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045408.188945:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cfa5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045408.188951:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cfa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045408.188957:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045408.188961:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cfa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045408.188968:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cfa5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045408.188980:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:0.0:1784045408.188983:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784045408.188988:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cfa5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045408.188993:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454cfa5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045408.189083:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:11433:x1870706863313920:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 271us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045408.189091:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 146 00010000:00010000:3.0:1784045408.214207:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045408.311572:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045408.311725:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863314048 00000100:00100000:1.0:1784045408.311734:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863314048 00000100:00100000:1.0:1784045408.311805:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:1.0:1784045408.311815:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863314048:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:1.0:1784045408.311850:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045408.311873:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000143db477/0x5475624df454cfac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f083 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784045408.311902:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a565f5b, atime: 0x6a565f5b, ctime: 0x6a565f5b, blocks: 0x8 00010000:00010000:1.0:1784045408.311924:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1784045408.311928:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045408.311939:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000143db477/0x5475624df454cfac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f083 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045408.311959:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000143db477/0x5475624df454cfac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f083 expref: 7 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045408.311973:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cde00, rc 0) 00000100:00100000:1.0:1784045408.312041:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2396:x1870706863314048:12345-192.168.203.44@tcp:101:cat.0 Request processed in 227us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045408.312048:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00080000:3.0:1784045408.312154:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045408.320317:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045408.320429:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863314176 00000100:00100000:2.0:1784045408.320438:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863314176 00002000:00100000:2.0:1784045408.320520:0:8419:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff939b835b4000 x1870706863314176/t0(0) o3->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:49/0 lens 488/0 e 0 to 0 dl 1784045419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045408.320532:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b835b4000 with x1870706863314176 ext(0->4095) 00002000:00010000:2.0:1784045408.320555:0:8419:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939b835b4000 00000100:00100000:2.0:1784045408.320600:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:2.0:1784045408.320610:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863314176:12345-192.168.203.44@tcp:3:cat.0 00000100:00100000:2.0:1784045408.321088:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863314176:12345-192.168.203.44@tcp:3:cat.0 Request processed in 176us (475us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1784045408.321099:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3 00002000:00100000:2.0:1784045408.321107:0:8419:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff939b835b4000 x1870706863314176/t0(0) o3->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:49/0 lens 488/4536 e 0 to 0 dl 1784045419 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784045408.321116:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b835b4000 with x1870706863314176 ext(0->4095) 00002000:00010000:2.0:1784045408.321119:0:8419:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939b835b4000 00000040:00080000:2.0:1784045408.404887:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045408.404896:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045408.404917:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1784045408.404926:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784045408.449294:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045408.449345:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045408.449386:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045408.449413:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045408.449437:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045408.449506:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863314432 00000100:00100000:0.0:1784045408.449515:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863314432 00000100:00100000:0.0:1784045408.449571:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863314688 00000100:00100000:0.0:1784045408.449574:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863314688 00000100:00100000:0.0:1784045408.449600:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863314816 00000100:00100000:0.0:1784045408.449603:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863314816 00000100:00100000:0.0:1784045408.449622:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 308 00000100:00100000:0.0:1784045408.449631:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863314432:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045408.449704:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863314432:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 74us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045408.449712:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 308 00000100:00100000:0.0:1784045408.449729:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 309 00000100:00100000:0.0:1784045408.449735:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863314688:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045408.449760:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863314688:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045408.449766:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 309 00000100:00100000:0.0:1784045408.449778:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 310 00000100:00100000:0.0:1784045408.449800:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863314816:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045408.449824:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863314816:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 25us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045408.449829:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 310 00000100:00100000:1.0:1784045408.449921:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863314560 00000100:00100000:1.0:1784045408.449925:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863314560 00000100:00100000:1.0:1784045408.449960:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 149 00000100:00100000:1.0:1784045408.449968:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863314560:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045408.450005:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863314560:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 38us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045408.450011:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 149 00000100:00100000:3.0:1784045408.450244:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863314304 00000100:00100000:3.0:1784045408.450249:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863314304 00000100:00100000:3.0:1784045408.450290:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 385 00000100:00100000:3.0:1784045408.450297:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863314304:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045408.450322:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863314304:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 27us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045408.450338:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 385 00000100:00080000:3.0:1784045408.450366:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045408.450370:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784045408.450372:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1784045408.724197:0:13778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784045408.915890:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873873024:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.915979:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045408.915979:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873873152:0@lo:400:kworker.0 00000100:00100000:1.0:1784045408.916037:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045408.916047:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c921f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873873536:0@lo:400:kworker.0 00000100:00100000:1.0:1784045408.916063:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873873664:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.916075:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045408.916095:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045408.916106:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873874048:0@lo:400:kworker.0 00000100:00100000:1.0:1784045408.916120:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873874176:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.916133:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045408.916153:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045408.916157:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1784045408.916166:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873872896:0@lo:400:kworker.0 00000100:00100000:1.0:1784045408.916173:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784045408.916182:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873873280:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.916198:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045408.916218:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045408.916225:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873873408:0@lo:400:kworker.0 00000100:00100000:1.0:1784045408.916236:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873873792:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.916252:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045408.916270:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045408.916273:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873873920:0@lo:400:kworker.0 00000100:00100000:1.0:1784045408.916296:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873874304:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.916303:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045408.916349:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873873152 00000100:00100000:1.0:1784045408.916357:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873873152 00000100:00100000:1.0:1784045408.916401:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873873408 00000100:00100000:1.0:1784045408.916405:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873873408 00000100:00100000:1.0:1784045408.916422:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784045408.916430:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873873152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.916477:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8368a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873874432:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.916509:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045408.916514:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873873152:12345-0@lo:400:kworker.0 Request processed in 81us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045408.916523:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784045408.916541:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873872896 00000100:00100000:3.0:1784045408.916546:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873872896 00000100:00100000:1.0:1784045408.916552:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784045408.916562:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873873408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.916578:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1784045408.916588:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873872896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045408.916602:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873873408:12345-0@lo:400:kworker.0 Request processed in 42us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045408.916609:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784045408.916638:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873872896:12345-0@lo:400:kworker.0 Request processed in 51us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045408.916646:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1784045408.916648:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873873792 00000100:00100000:1.0:1784045408.916653:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873873792 00000100:00100000:3.0:1784045408.916683:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873873024 00000100:00100000:3.0:1784045408.916688:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873873024 00000100:00100000:1.0:1784045408.916693:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873873920 00000100:00100000:1.0:1784045408.916698:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873873920 00000100:00100000:3.0:1784045408.916711:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873873536 00000100:00100000:3.0:1784045408.916716:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873873536 00000100:00100000:1.0:1784045408.916723:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873874432 00000100:00100000:1.0:1784045408.916729:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873874432 00000100:00100000:3.0:1784045408.916735:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873873664 00000100:00100000:3.0:1784045408.916740:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873873664 00000100:00100000:1.0:1784045408.916757:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784045408.916761:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873874048 00000100:00100000:3.0:1784045408.916765:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873874048 00000100:00100000:1.0:1784045408.916767:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873873792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045408.916810:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873873792:12345-0@lo:400:kworker.0 Request processed in 46us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045408.916816:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784045408.916829:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784045408.916834:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873873920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.916862:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873874176 00000100:00100000:1.0:1784045408.916863:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873873920:12345-0@lo:400:kworker.0 Request processed in 28us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045408.916867:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873874176 00000100:00100000:1.0:1784045408.916873:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784045408.916892:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873873280 00000100:00100000:1.0:1784045408.916893:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784045408.916896:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873873280 00000100:00100000:1.0:1784045408.916903:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3624:x1870706873874432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.916915:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1784045408.916923:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873873024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045408.916931:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3624:x1870706873874432:12345-0@lo:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045408.916937:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784045408.916964:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873873024:12345-0@lo:400:kworker.0 Request processed in 40us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045408.916965:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1784045408.916975:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1784045408.916977:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873873536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.916993:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1784045408.917001:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873873664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045408.917013:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873873536:12345-0@lo:400:kworker.0 Request processed in 37us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045408.917020:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1784045408.917039:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873873664:12345-0@lo:400:kworker.0 Request processed in 37us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045408.917040:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1784045408.917057:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1784045408.917061:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873874048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.917076:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1784045408.917083:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873874176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045408.917101:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873874048:12345-0@lo:400:kworker.0 Request processed in 43us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045408.917109:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1784045408.917122:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873874176:12345-0@lo:400:kworker.0 Request processed in 39us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045408.917128:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1784045408.917271:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00080000:3.0:1784045408.917291:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784045408.917295:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045408.917298:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784045408.917301:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045408.917339:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873872896:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.917354:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873873408:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.917364:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873873920:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.917373:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8368a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873874432:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.917382:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c921f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873873536:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.917393:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873874048:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.917403:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873873024:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.917467:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045408.917496:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873873152:0@lo:400:kworker.0 00010000:00080000:3.0:1784045408.917509:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c83ca4700 x1870706873873664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045408.917519:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873873664:0@lo:400:kworker.0 00010000:00080000:3.0:1784045408.917537:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b83689c00 x1870706873874176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045408.917546:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873874176:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.917568:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873873792:0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.917592:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873874304 00000100:00100000:3.0:1784045408.917691:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873874304 00000100:00100000:3.0:1784045408.917726:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784045408.917734:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873874304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045408.917852:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873874304:12345-0@lo:400:kworker.0 Request processed in 118us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045408.917861:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1784045408.917880:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045408.917897:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873874304:0@lo:400:kworker.0 00000100:00100000:2.0:1784045408.918888:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045408.918905:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc10f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873874560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045408.918950:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045408.918988:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873874560 00000100:00100000:2.0:1784045408.918999:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873874560 00000100:00100000:2.0:1784045408.919032:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784045408.919040:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873874560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784045408.919067:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1784045408.919107:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873874560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045408.919114:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784045408.919151:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc10f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873874560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045408.919436:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873873280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045408.919508:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873873280:12345-0@lo:400:kworker.0 Request processed in 2373us (3292us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045408.919516:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1784045408.919549:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873873280:0@lo:400:kworker.0 00010000:00010000:0.0:1784045409.237939:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045409.427670:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873874688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045409.427772:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045409.428114:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873874688 00000100:00100000:3.0:1784045409.428122:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873874688 00000100:00100000:3.0:1784045409.428180:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784045409.428190:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873874688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784045409.428219:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045409.428268:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873874688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045409.428275:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784045409.428318:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873874688:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045409.428477:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873874816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045409.428526:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045409.428799:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873874816 00000100:00100000:0.0:1784045409.428875:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873874816 00000100:00100000:0.0:1784045409.429648:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1784045409.429663:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1870706873874816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045409.429684:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045409.429752:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1870706873874816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045409.429759:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784045409.430176:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873874816:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1784045409.962552:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1784045409.962570:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:3.0:1784045410.260343:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784045410.978004:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1784045410.978021:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1784045410.979545:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1784045410.979589:0:6475:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939b83101b40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1784045410.979594:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939b82023c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff939b83101540 00000020:00080000:0.0:1784045410.979597:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939b82023500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939b833f7200 00000020:00080000:1.0:1784045410.979857:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:0.0:1784045410.979914:0:6475:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1784045410.979933:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1784045410.980129:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cf27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.980140:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cf27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.980148:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cf27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.980154:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045410.980159:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cf27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.980168:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cf27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.980186:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff939c93a83b00) 00010000:00010000:3.0:1784045410.980189:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045410.980194:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cf27 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045410.980200:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454cf27 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045411.291815:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045411.987799:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045411.987823:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873874944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045411.987892:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045411.988083:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873874944 00000100:00100000:3.0:1784045411.988092:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873874944 00000100:00100000:3.0:1784045411.988163:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784045411.988188:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873874944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045411.988217:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1784045411.988265:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873874944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045411.988272:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1784045411.988345:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045411.988416:0:3624:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1784045411.988422:0:3624:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1784045411.988471:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873874944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045411.988617:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045411.988627:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873875072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045411.988659:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045411.988837:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873875072 00000100:00100000:1.0:1784045411.988844:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873875072 00000100:00100000:1.0:1784045411.988890:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784045411.988897:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873875072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045411.988910:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784045411.988956:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873875072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045411.988963:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784045411.989042:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873875072:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784045411.989107:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784045412.307576:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045412.499764:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045412.499788:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873875200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784045412.499861:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045412.499938:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873875200 00000100:00100000:3.0:1784045412.499947:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873875200 00000100:00100000:3.0:1784045412.500008:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784045412.500017:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873875200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045412.500058:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045412.500112:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873875200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045412.500120:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784045412.500167:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873875200:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784045413.332099:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045413.354603:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045413.355178:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863314944 00000100:00100000:0.0:1784045413.355192:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863314944 00000100:00080000:2.0:1784045413.355464:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045413.355603:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 147 00000100:00100000:0.0:1784045413.355620:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+13:11076:x1870706863314944:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1784045413.355739:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+13:11076:x1870706863314944:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 Request processed in 125us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045413.358981:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 147 00000100:00100000:3.0:1784045413.360416:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045413.360572:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863315072 00000100:00100000:2.0:1784045413.360584:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863315072 00000100:00100000:2.0:1784045413.360673:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 148 00000100:00100000:2.0:1784045413.360685:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:11076:x1870706863315072:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784045413.360823:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:11076:x1870706863315072:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 Request processed in 140us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045413.360831:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 148 00000100:00080000:3.0:1784045413.360970:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045413.378271:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045413.378394:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863315328 00000100:00100000:0.0:1784045413.378408:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863315328 00000100:00100000:0.0:1784045413.378514:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:0.0:1784045413.378525:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+13:11076:x1870706863315328:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784045413.379171:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:11076:x1870706863315328:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 645us (912us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1784045413.379181:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:0.0:1784045413.567561:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045413.567667:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045413.567701:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045413.567738:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045413.567762:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045413.567791:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863315968 00000100:00100000:0.0:1784045413.567800:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863315968 00000100:00100000:3.0:1784045413.567809:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863315712 00000100:00100000:3.0:1784045413.567816:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863315712 00000100:00100000:0.0:1784045413.567860:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863315840 00000100:00100000:0.0:1784045413.567865:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863315840 00000100:00100000:3.0:1784045413.567873:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863315584 00000100:00100000:3.0:1784045413.567878:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863315584 00000100:00100000:0.0:1784045413.567899:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 317 00000100:00100000:0.0:1784045413.567912:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863315968:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045413.567917:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 154 00000100:00100000:3.0:1784045413.567928:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863315712:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045413.568003:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863315968:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045413.568012:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 317 00000100:00100000:0.0:1784045413.568028:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 318 00000100:00100000:0.0:1784045413.568035:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863315840:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045413.568059:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863315840:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 25us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045413.568065:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 318 00000100:00100000:0.0:1784045413.568085:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 155 00000100:00100000:0.0:1784045413.568105:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863315584:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045413.568130:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863315584:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 39us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045413.568136:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 155 00000100:00100000:3.0:1784045413.568181:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863315712:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 253us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045413.568191:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 154 00000100:00080000:0.0:1784045413.568192:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045413.568198:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045413.568200:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045413.568203:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784045413.571178:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863315456 00000100:00100000:1.0:1784045413.571194:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863315456 00000100:00100000:1.0:1784045413.571267:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 387 00000100:00100000:1.0:1784045413.571277:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863315456:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045413.571420:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863315456:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 144us (3868us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045413.571459:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 387 00000100:00100000:0.0:1784045413.718422:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045413.718556:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863316096 00000100:00100000:2.0:1784045413.718624:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863316096 00000100:00100000:2.0:1784045413.718686:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 149 00000100:00100000:2.0:1784045413.718697:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:11892:x1870706863316096:12345-192.168.203.44@tcp:101:lsof.0 00010000:00010000:2.0:1784045413.718717:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045413.718738:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454cfb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f08a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045413.719064:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cfba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045413.719079:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cfba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045413.719090:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cfba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045413.719137:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784045413.719141:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045413.719176:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cfba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045413.719200:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454cfb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f08a expref: 7 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045413.719220:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cfba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f08a expref: 6 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045413.719230:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85b00) 00010000:00010000:2.0:1784045413.719233:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045413.719236:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171200, rc 0) 00000100:00100000:2.0:1784045413.719307:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+6:11892:x1870706863316096:12345-192.168.203.44@tcp:101:lsof.0 Request processed in 602us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045413.719314:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 149 00000100:00100000:3.0:1784045414.038567:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc10fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873875328:0@lo:400:kworker.0 00000100:00100000:3.0:1784045414.038650:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045414.038701:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873875840:0@lo:400:kworker.0 00000100:00100000:3.0:1784045414.038727:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045414.038735:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873875584:0@lo:400:kworker.0 00000100:00100000:3.0:1784045414.038745:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873876352:0@lo:400:kworker.0 00000100:00100000:3.0:1784045414.038764:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045414.038764:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045414.038793:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873876864:0@lo:400:kworker.0 00000100:00100000:2.0:1784045414.038815:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873875712:0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.038961:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc10f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873875456:0@lo:400:kworker.0 00000100:00100000:0.0:1784045414.043207:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873876096:0@lo:400:kworker.0 00000100:00100000:0.0:1784045414.043278:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045414.043473:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873876608:0@lo:400:kworker.0 00000100:00100000:0.0:1784045414.043501:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045414.043901:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873876096 00000100:00100000:0.0:1784045414.043910:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873876096 00000100:00100000:0.0:1784045414.044136:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873876608 00000100:00100000:0.0:1784045414.044141:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873876608 00000100:00100000:0.0:1784045414.044173:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1784045414.044182:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873876096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045414.044242:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873876096:12345-0@lo:400:kworker.0 Request processed in 61us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045414.044249:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1784045414.044267:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1784045414.044274:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873876608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045414.044314:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873876608:12345-0@lo:400:kworker.0 Request processed in 41us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045414.044320:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00080000:0.0:1784045414.044339:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1784045414.045860:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b833ed880 x1870706873876096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045414.045875:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873876096:0@lo:400:kworker.0 00010000:00080000:0.0:1784045414.045888:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc1375c00 x1870706873876608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045414.045895:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1375c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873876608:0@lo:400:kworker.0 00000100:00100000:3.0:1784045414.045924:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045414.046087:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873876352 00000100:00100000:0.0:1784045414.046093:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873876352 00000100:00100000:2.0:1784045414.047914:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873875840 00000100:00100000:2.0:1784045414.047943:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873875840 00000100:00100000:1.0:1784045414.048087:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045414.048129:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873875968:0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.048157:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045414.048175:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc1377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873876480:0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.048196:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045414.048212:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873876992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045414.048236:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045414.048476:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873876864 00000100:00100000:0.0:1784045414.048481:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873876864 00000100:00100000:0.0:1784045414.048517:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784045414.048526:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873876352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045414.048537:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784045414.048544:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873876864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045414.048591:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873876864:12345-0@lo:400:kworker.0 Request processed in 47us (2667us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045414.048599:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784045414.048649:0:3626:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1784045414.048655:0:3626:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1784045414.048673:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939c812afb80, transno 4294967305 00000100:00100000:3.0:1784045414.048688:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873876864:0@lo:400:kworker.0 00000100:00100000:3.0:1784045414.048727:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045414.048751:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873875456 00000100:00100000:3.0:1784045414.048754:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873875456 00000100:00100000:0.0:1784045414.048796:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873876352:12345-0@lo:400:kworker.0 Request processed in 272us (10030us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045414.048803:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784045414.049215:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873875968 00000100:00100000:1.0:1784045414.049220:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873875968 00000100:00100000:1.0:1784045414.049243:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873876480 00000100:00100000:1.0:1784045414.049246:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873876480 00000100:00100000:1.0:1784045414.049258:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873875712 00000100:00100000:1.0:1784045414.049261:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873875712 00000100:00100000:1.0:1784045414.049275:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1784045414.049282:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873875968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.049338:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873875968:12345-0@lo:400:kworker.0 Request processed in 56us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045414.049344:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1784045414.049362:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1784045414.049368:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873876480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.049398:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873876480:12345-0@lo:400:kworker.0 Request processed in 30us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045414.049405:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1784045414.049429:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1784045414.049435:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873875712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.049488:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873875712:12345-0@lo:400:kworker.0 Request processed in 53us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045414.049495:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1784045414.049533:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873875968:0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.049545:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc1377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873876480:0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.049616:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873875328 00000100:00100000:1.0:1784045414.049620:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873875328 00000100:00100000:1.0:1784045414.049650:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1784045414.049656:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873875328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.049689:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97797850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873875328:12345-0@lo:400:kworker.0 Request processed in 33us (11039us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045414.049696:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00080000:1.0:1784045414.049723:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784045414.049727:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045414.049730:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045414.049781:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc10fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873875328:0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.049795:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873876352:0@lo:400:kworker.0 00000100:00100000:3.0:1784045414.049900:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1784045414.049906:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873875456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045414.049955:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873875456:12345-0@lo:400:kworker.0 Request processed in 48us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045414.049962:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1784045414.050440:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc10f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873875456:0@lo:400:kworker.0 00000100:00100000:2.0:1784045414.052260:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873875584 00000100:00100000:2.0:1784045414.052271:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873875584 00000100:00100000:2.0:1784045414.052326:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873876992 00000100:00100000:2.0:1784045414.052330:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873876992 00000100:00100000:2.0:1784045414.052345:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784045414.052352:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873875840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045414.052432:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873875840:12345-0@lo:400:kworker.0 Request processed in 81us (13703us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045414.052439:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784045414.052470:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784045414.052476:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1870706873875584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045414.052516:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1870706873875584:12345-0@lo:400:kworker.0 Request processed in 40us (13751us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045414.052523:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784045414.052536:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784045414.052541:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873876992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784045414.052871:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1784045414.052917:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873875840:0@lo:400:kworker.0 00000100:00100000:2.0:1784045414.053473:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873876992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 931us (5235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045414.053481:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784045414.053521:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873876992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045414.060549:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873875584:0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.062816:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873875712:0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.062835:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873876224:0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.062901:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045414.062945:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873876736:0@lo:400:kworker.0 00000100:00100000:2.0:1784045414.062985:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873876224 00000100:00100000:2.0:1784045414.062993:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873876224 00000100:00100000:2.0:1784045414.063073:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1784045414.063078:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045414.063082:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873876224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045414.063122:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045414.063128:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873876224:12345-0@lo:400:kworker.0 Request processed in 48us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045414.063144:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784045414.063158:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873876736 00000100:00100000:2.0:1784045414.063161:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873876736 00000100:00100000:1.0:1784045414.063181:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873876224:0@lo:400:kworker.0 00000100:00100000:2.0:1784045414.063190:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784045414.063196:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873876736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045414.063228:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873876736:12345-0@lo:400:kworker.0 Request processed in 32us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045414.063234:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1784045414.063247:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873876736:0@lo:400:kworker.0 00000100:00080000:0.0:1784045414.063287:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784045414.359103:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045414.547859:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045414.547881:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873877248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045414.547948:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045414.548060:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873877248 00000100:00100000:2.0:1784045414.548068:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873877248 00000100:00100000:2.0:1784045414.548121:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784045414.548130:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873877248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784045414.548159:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045414.548205:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873877248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045414.548212:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784045414.548317:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873877120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045414.548359:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045414.548574:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873877120 00000100:00100000:3.0:1784045414.548578:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873877120 00000100:00100000:3.0:1784045414.548615:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784045414.548623:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873877120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784045414.548634:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045414.548677:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873877120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045414.548683:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784045414.548727:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873877248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045414.548805:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873877120:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784045415.379780:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045416.407244:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784045416.597225:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:1.0:1784045416.597244:0:6475:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1784045416.597358:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1784045416.597369:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1784045417.108628:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873877376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784045417.108698:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045417.108774:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873877376 00000100:00100000:1.0:1784045417.108782:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873877376 00000100:00100000:1.0:1784045417.108835:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784045417.108844:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873877376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045417.108885:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784045417.108927:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873877376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045417.108935:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1784045417.108966:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045417.108998:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873877376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784045417.111025:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873877504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045417.111085:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045417.111145:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873877504 00000100:00100000:1.0:1784045417.111152:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873877504 00000100:00100000:1.0:1784045417.111199:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784045417.111207:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873877504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045417.111226:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1784045417.111265:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83688380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873877504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045417.111272:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1784045417.111314:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045417.111344:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8364b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873877504:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1784045417.160392:0:14539:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:10:15 (1784045415) 00010000:00010000:3.0:1784045417.428041:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045417.619958:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873877632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784045417.620029:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045417.621254:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873877632 00000100:00100000:2.0:1784045417.621264:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873877632 00000100:00100000:2.0:1784045417.621373:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1784045417.621383:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873877632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784045417.621418:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1784045417.625475:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873877632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4082us (5434us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045417.625490:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1784045417.628438:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873877632:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784045418.451627:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784045418.643989:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045418.643998:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045418.644106:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1784045418.644115:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784045418.656622:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045418.656731:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863316352 00000100:00100000:1.0:1784045418.656745:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863316352 00000100:00100000:1.0:1784045418.656848:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 150 00000100:00100000:1.0:1784045418.656861:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+13:12159:x1870706863316352:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045418.656887:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045418.656909:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454cfc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f091 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.656979:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454cfc8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.656994:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454cfc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657005:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454cfc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657019:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cfcf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657026:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cfcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657052:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cfcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657140:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cfd6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657149:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cfd6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657155:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cfd6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045418.657164:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1784045418.657253:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454cfc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657262:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454cfc8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657278:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454cfc8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657284:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045418.657289:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454cfc8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657296:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454cfc8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657308:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff939b83091400) 00010000:00010000:1.0:1784045418.657311:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045418.657321:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454cfc8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657328:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454cfc8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657344:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cfcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657350:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cfcf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657356:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cfcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657361:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cd600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045418.657364:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cfcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657370:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cfcf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657378:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff939b81924000) 00010000:00010000:1.0:1784045418.657391:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045418.657394:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cfcf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657400:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454cfcf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657882:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454cfc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f091 expref: 16 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657910:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cfd6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f091 expref: 15 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.657917:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c813ee300) 00010000:00010000:1.0:1784045418.657920:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045418.657922:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cda00, rc 0) 00000100:00100000:1.0:1784045418.657993:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:12159:x1870706863316352:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1136us (1387us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1784045418.658000:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 150 00000100:00080000:3.0:1784045418.658161:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045418.689126:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045418.689161:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045418.689316:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863316480 00000100:00100000:3.0:1784045418.689325:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863316480 00000100:00100000:3.0:1784045418.689414:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 151 00000100:00100000:3.0:1784045418.689424:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:12159:x1870706863316480:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784045418.689977:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:12159:x1870706863316480:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 Request processed in 544us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045418.689986:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 151 00000100:00100000:0.0:1784045418.690142:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045418.690172:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045418.690196:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863316736 00000100:00100000:2.0:1784045418.690203:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863316736 00000100:00100000:2.0:1784045418.690240:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 389 00000100:00100000:2.0:1784045418.690247:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2396:x1870706863316736:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045418.690292:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97794450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2396:x1870706863316736:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 46us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045418.690300:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 389 00000100:00100000:1.0:1784045418.696128:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863316608 00000100:00100000:1.0:1784045418.696145:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863316608 00000100:00100000:1.0:1784045418.696252:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:1.0:1784045418.696263:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:2397:x1870706863316608:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045418.696289:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045418.696314:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454cfd6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f091 expref: 15 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045418.696345:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c813ee300) 00010000:00010000:1.0:1784045418.696350:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045418.702321:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:2397:x1870706863316608:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 6046us (13144us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045418.702338:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:0.0:1784045418.703509:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045418.703539:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045418.703645:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863317248 00000100:00100000:1.0:1784045418.703654:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863317248 00000100:00100000:2.0:1784045418.703738:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863316864 00000100:00100000:2.0:1784045418.703743:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863316864 00000100:00100000:0.0:1784045418.703890:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045418.703922:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045418.703944:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863316992 00000100:00100000:0.0:1784045418.703948:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863316992 00000100:00100000:3.0:1784045418.703996:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863317120 00000100:00100000:3.0:1784045418.704000:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863317120 00000100:00100000:1.0:1784045418.704078:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863317376 00000100:00100000:1.0:1784045418.704110:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863317376 00000100:00100000:2.0:1784045418.704162:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 325 00000100:00100000:2.0:1784045418.704171:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2396:x1870706863317248:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045418.704247:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2396:x1870706863317248:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 76us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045418.704254:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 325 00000100:00100000:2.0:1784045418.704290:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 326 00000100:00100000:2.0:1784045418.704298:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8357b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863316864:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045418.704323:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8357b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863316864:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 27us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045418.704330:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 326 00000100:00080000:2.0:1784045418.706822:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045418.706832:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045418.706835:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045418.706856:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045418.708491:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 160 00000100:00100000:0.0:1784045418.708522:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863316992:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045418.708603:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863316992:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 102us (18430us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045418.708610:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 160 00000100:00100000:0.0:1784045418.711957:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045418.712103:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863317504 00000100:00100000:2.0:1784045418.712112:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863317504 00000100:00100000:2.0:1784045418.712141:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 327 00000100:00100000:2.0:1784045418.712150:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2396:x1870706863317376:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045418.712320:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 152 00000100:00100000:1.0:1784045418.712329:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:12159:x1870706863317504:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784045418.712643:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2396:x1870706863317376:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 493us (8719us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045418.712661:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 327 00000100:00100000:3.0:1784045418.712832:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 161 00000100:00100000:3.0:1784045418.712840:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863317120:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045418.716754:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:12159:x1870706863317504:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 Request processed in 4414us (4793us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045418.716769:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 152 00000100:00100000:3.0:1784045418.726033:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2396:x1870706863317120:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 13181us (22131us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045418.726049:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 161 00000040:00080000:3.0:1784045418.965867:0:13778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784045419.161503:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873877888:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.161580:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045419.161632:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c921f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873878400:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.161654:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045419.161675:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873878912:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.161694:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045419.161720:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1784045419.161727:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873877760:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.161753:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045419.161773:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873878272:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.161795:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045419.161844:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873878784:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.161868:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045419.161884:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c83ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873879296:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.162147:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045419.162179:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873878016:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.162204:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045419.162220:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c921f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873878528:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.162244:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045419.162282:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873879040:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.162303:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045419.162317:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784045419.162322:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873878144:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.162342:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045419.162354:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c921f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873878656:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.162374:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045419.162389:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873879168:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.162410:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045419.162464:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873877888 00000100:00100000:3.0:1784045419.162472:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873877888 00000100:00100000:3.0:1784045419.162567:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873878400 00000100:00100000:3.0:1784045419.162572:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873878400 00000100:00100000:3.0:1784045419.162597:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873878912 00000100:00100000:3.0:1784045419.162600:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873878912 00000100:00100000:3.0:1784045419.162613:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873878528 00000100:00100000:3.0:1784045419.162616:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873878528 00000100:00100000:3.0:1784045419.162628:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873879040 00000100:00100000:3.0:1784045419.162631:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873879040 00000100:00100000:3.0:1784045419.162655:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873878144 00000100:00100000:3.0:1784045419.162658:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873878144 00000100:00100000:3.0:1784045419.162673:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1784045419.162682:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873877888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.162750:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873877888:12345-0@lo:400:kworker.0 Request processed in 69us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045419.162758:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1784045419.162776:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1784045419.162783:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873878400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.162812:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873878400:12345-0@lo:400:kworker.0 Request processed in 30us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045419.162818:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1784045419.162830:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1784045419.162837:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873878912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.162866:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873878912:12345-0@lo:400:kworker.0 Request processed in 29us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045419.162872:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1784045419.162885:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1784045419.162890:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873878528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.162921:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873878528:12345-0@lo:400:kworker.0 Request processed in 31us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045419.162928:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1784045419.162949:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1784045419.162955:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873879040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.162983:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873879040:12345-0@lo:400:kworker.0 Request processed in 28us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045419.162995:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1784045419.163009:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1784045419.163015:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873878144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.163045:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873878144:12345-0@lo:400:kworker.0 Request processed in 30us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045419.163050:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1784045419.163071:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873877760 00000100:00100000:3.0:1784045419.163075:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873877760 00000100:00100000:3.0:1784045419.163101:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1784045419.163108:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873877760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.163137:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97795c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873877760:12345-0@lo:400:kworker.0 Request processed in 30us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045419.163143:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1784045419.163170:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873878784 00000100:00100000:3.0:1784045419.163174:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873878784 00000100:00100000:3.0:1784045419.163196:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873879296 00000100:00100000:3.0:1784045419.163199:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873879296 00000100:00100000:3.0:1784045419.163212:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873878656 00000100:00100000:3.0:1784045419.163215:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873878656 00000100:00100000:3.0:1784045419.163226:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873879168 00000100:00100000:3.0:1784045419.163228:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873879168 00000100:00100000:3.0:1784045419.163241:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784045419.163246:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873878784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.163290:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873878784:12345-0@lo:400:kworker.0 Request processed in 44us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045419.163296:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784045419.163308:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784045419.163321:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873879296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.163352:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873879296:12345-0@lo:400:kworker.0 Request processed in 32us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045419.163357:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784045419.163369:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784045419.163375:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873878656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.163402:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873878656:12345-0@lo:400:kworker.0 Request processed in 27us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045419.163407:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784045419.163418:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784045419.163424:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873879168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.163475:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873879168:12345-0@lo:400:kworker.0 Request processed in 51us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045419.164865:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873878272 00000100:00100000:0.0:1784045419.164877:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873878272 00000100:00100000:0.0:1784045419.164918:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873878016 00000100:00100000:0.0:1784045419.164921:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873878016 00000100:00100000:0.0:1784045419.164935:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784045419.164943:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873878272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045419.165010:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873878272:12345-0@lo:400:kworker.0 Request processed in 67us (3213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045419.165016:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784045419.165031:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784045419.165038:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873878016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045419.165066:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873878016:12345-0@lo:400:kworker.0 Request processed in 29us (2862us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045419.165071:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784045419.165151:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1784045419.165175:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045419.165180:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045419.165184:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784045419.165186:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045419.165227:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873878144:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.165239:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c921f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873878656:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.165249:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873879168:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.165258:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873878016:0@lo:400:kworker.0 00010000:00080000:3.0:1784045419.165284:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c921f0e00 x1870706873878528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045419.165310:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c921f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873878528:0@lo:400:kworker.0 00010000:00080000:3.0:1784045419.165323:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf4cd880 x1870706873879040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045419.165331:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873879040:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.165375:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873877760:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.165386:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873878272:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.165396:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873878784:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.165406:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c83ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873879296:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.165668:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873877888:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.165684:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c921f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873878400:0@lo:400:kworker.0 00000100:00100000:3.0:1784045419.165693:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873878912:0@lo:400:kworker.0 00000100:00100000:1.0:1784045419.167736:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873879424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045419.167806:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045419.168812:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873879424 00000100:00100000:1.0:1784045419.168823:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873879424 00000100:00100000:1.0:1784045419.168883:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1784045419.168893:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873879424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045419.168928:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1784045419.168990:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873879424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045419.168997:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1784045419.169049:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873879424:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784045419.476590:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045419.667778:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873879552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045419.667963:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045419.668046:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045419.668055:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873879680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045419.668087:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045419.668130:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873879552 00000100:00100000:1.0:1784045419.668138:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873879552 00000100:00100000:1.0:1784045419.668191:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873879680 00000100:00100000:1.0:1784045419.668203:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873879680 00000100:00100000:1.0:1784045419.668232:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784045419.668243:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873879552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045419.668369:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045419.668428:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873879552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 186us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045419.668437:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784045419.668502:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784045419.668513:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873879680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784045419.668526:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045419.668562:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873879680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045419.668570:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784045419.668713:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873879680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045419.668737:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873879552:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1784045419.676872:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045419.676882:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784045419.681422:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1784045419.681457:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1784045420.500114:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045420.755928:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045420.757131:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863317632 00000100:00100000:3.0:1784045420.757142:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863317632 00000100:00080000:1.0:1784045420.757207:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045420.757217:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 153 00000100:00100000:3.0:1784045420.757227:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:12201:x1870706863317632:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045420.757246:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045420.757277:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cfe4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f098 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757352:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cfeb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757373:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cfeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757385:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cfeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757401:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454cff2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757415:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454cff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757428:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454cff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757490:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cfeb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757498:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cfeb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757505:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cfeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757511:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106e600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045420.757516:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cfeb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757527:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cfeb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757539:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85b00) 00010000:00010000:3.0:1784045420.757547:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045420.757553:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cfeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757558:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454cfeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757570:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454cff2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757576:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454cff2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757582:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454cff2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757587:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045420.757590:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454cff2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757596:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454cff2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757604:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff939c93a85200) 00010000:00010000:3.0:1784045420.757606:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045420.757609:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454cff2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757615:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454cff2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757652:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cfe4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f098 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757671:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85b00) 00010000:00010000:3.0:1784045420.757673:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045420.757677:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454cfe4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f098 expref: 15 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.757686:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106ea00, rc 0) 00000100:00100000:3.0:1784045420.757754:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:12201:x1870706863317632:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 528us (1835us total) trans 0 rc 301/301 00000100:00100000:3.0:1784045420.757762:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 153 00000100:00100000:1.0:1784045420.766717:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045420.770078:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863317888 00000100:00100000:0.0:1784045420.770090:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863317888 00000100:00100000:0.0:1784045420.770146:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 154 00000100:00100000:0.0:1784045420.770156:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:12201:x1870706863317888:12345-192.168.203.44@tcp:36:lfs.0 00010000:00010000:0.0:1784045420.770212:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045420.770240:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454c938 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eebc expref: 14 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.770272:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85b00) 00010000:00010000:0.0:1784045420.770277:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045420.770339:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.770364:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cfba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f08a expref: 5 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.770373:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.770494:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cfba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f08a expref: 5 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.770508:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cfba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f08a expref: 5 pid: 6497 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045420.770523:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873879808:192.168.203.44@tcp:104: 00000100:00100000:0.0:1784045420.770614:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939ca00233c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045420.772677:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b833ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873879808:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045420.772702:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045420.773172:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045420.775241:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863318016 00000100:00100000:1.0:1784045420.775264:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863318016 00010000:00010000:1.0:1784045420.775382:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cfba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f08a expref: 6 pid: 6497 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045420.775430:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 79 00000100:00100000:1.0:1784045420.775469:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2395:x1870706863318016:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045420.775485:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045420.775492:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cfba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f08a expref: 6 pid: 6497 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.775507:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cfba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f08a expref: 6 pid: 6497 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.775542:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454cfba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f08a expref: 6 pid: 6497 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.775557:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85b00) 00010000:00010000:1.0:1784045420.775562:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.775572:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.775579:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.775602:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045420.775656:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863318016:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 189us (2485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045420.775664:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 79 00010000:00010000:1.0:1784045420.776001:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.776010:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.776038:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d000 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.776047:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d000 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.776054:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d000 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.777279:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d007 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.777295:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d007 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.777302:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d007 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045420.777318:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b70fb5cf reply state 000000009c1580f6 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d007 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.777328:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d007 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.777335:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:1.0:1784045420.777338:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784045420.777341:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784045420.777347:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1784045420.777355:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.777362:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.777375:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.777381:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045420.777386:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.777394:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.777415:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85b00) 00010000:00010000:1.0:1784045420.777418:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045420.777422:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.777429:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454cff9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045420.777471:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b70fb5cf reply state 000000009c1580f6 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d000 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.777482:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045420.777488:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff939b81924c00) 00010000:00010000:1.0:1784045420.777491:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784045420.777493:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784045420.777592:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:12201:x1870706863317888:12345-192.168.203.44@tcp:36:lfs.0 Request processed in 7434us (10877us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1784045420.777599:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 154 00000100:00080000:0.0:1784045420.781736:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045420.880699:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045420.887388:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863318144 00000100:00100000:3.0:1784045420.887402:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863318144 00000100:00100000:3.0:1784045420.887556:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 155 00000100:00100000:3.0:1784045420.887568:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+15:12209:x1870706863318144:12345-192.168.203.44@tcp:101:lctl.0 00010000:00010000:3.0:1784045420.887647:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045420.887673:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d00e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f09f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.887741:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030200/0x5475624df454d015 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.887752:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030200/0x5475624df454d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.887760:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030200/0x5475624df454d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045420.887896:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784045420.887914:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784045420.887937:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030200/0x5475624df454d015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.887961:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d00e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f09f expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.888015:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030200/0x5475624df454d015 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f09f expref: 16 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045420.888024:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85200) 00010000:00010000:3.0:1784045420.888028:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045420.888031:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030200, rc 0) 00000100:00100000:3.0:1784045420.888102:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:12209:x1870706863318144:12345-192.168.203.44@tcp:101:lctl.0 Request processed in 536us (7698us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045420.888109:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 155 00000100:00100000:1.0:1784045420.950619:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045420.950725:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863318272 00000100:00100000:0.0:1784045420.950735:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863318272 00000100:00100000:0.0:1784045420.950798:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 156 00000100:00100000:0.0:1784045420.950809:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+16:12215:x1870706863318272:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1784045420.950828:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045420.950865:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d01c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f0a6 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.950931:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d023 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.950946:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d023 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.950959:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d023 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.950970:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d02a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.950978:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d02a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.950984:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d02a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951057:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454d031 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951067:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454d031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951074:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454d031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045420.951121:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1784045420.951125:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784045420.951145:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454d031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951164:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d023 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951171:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d023 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951178:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d023 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951184:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045420.951189:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d023 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951196:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d023 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951209:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85200) 00010000:00010000:0.0:1784045420.951212:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045420.951216:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951223:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951238:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d02a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951245:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d02a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951264:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d02a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951276:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045420.951280:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d02a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951287:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d02a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951296:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff939b81924c00) 00010000:00010000:0.0:1784045420.951298:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045420.951301:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d02a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951307:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d02a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951686:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d01c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0a6 expref: 18 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951704:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454d031 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0a6 expref: 17 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.951711:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:0.0:1784045420.951714:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784045420.951717:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b3200, rc 0) 00000100:00100000:0.0:1784045420.951900:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:12215:x1870706863318272:12345-192.168.203.44@tcp:101:bash.0 Request processed in 1092us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045420.951909:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 156 00000100:00100000:0.0:1784045420.965721:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045420.966088:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863318528 00000100:00100000:2.0:1784045420.966099:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863318528 00000100:00100000:2.0:1784045420.966161:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 157 00000100:00100000:2.0:1784045420.966172:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:12215:x1870706863318528:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1784045420.966192:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045420.966212:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d038 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f0ad expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.966347:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d03f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.966363:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d03f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.966375:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d03f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.972277:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454d046 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.973118:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454d046 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.973153:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454d046 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784045420.974287:0:10615:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1784045420.974496:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d04d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.974508:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d04d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.975328:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d04d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.975375:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d03f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.975383:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d03f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.975390:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d03f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.975397:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045420.975401:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d03f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.975409:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d03f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.975422:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:2.0:1784045420.975425:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045420.976053:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d03f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.976063:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d03f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045420.976080:0:10615:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bfa9d785 reply state 00000000050cca77 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454d046 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.976092:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454d046 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.976099:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c900) 00010000:00010000:2.0:1784045420.976102:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784045420.976104:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784045420.976150:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d038 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ad expref: 20 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.976165:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d04d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ad expref: 19 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045420.976173:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310cd00) 00010000:00010000:2.0:1784045420.976176:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045420.976178:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171400, rc 0) 00000100:00100000:2.0:1784045420.976243:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:12215:x1870706863318528:12345-192.168.203.44@tcp:101:bash.0 Request processed in 10072us (10531us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1784045420.976930:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 157 00000100:00100000:2.0:1784045420.979727:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045420.979859:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863318656 00000100:00100000:0.0:1784045420.979869:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863318656 00000100:00100000:0.0:1784045420.979947:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:0.0:1784045420.979957:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8364b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863318656:12345-192.168.203.44@tcp:101:bash.0 00000100:00080000:1.0:1784045420.980055:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784045420.980167:0:8648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045420.980190:0:8648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba98b27f/0x5475624df454d05b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f0b4 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784045420.980216:0:8648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784045420.980249:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1784045420.980328:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045420.980340:0:8648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba98b27f/0x5475624df454d05b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0b4 expref: 6 pid: 8648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.980361:0:8648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba98b27f/0x5475624df454d05b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0b4 expref: 6 pid: 8648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.980373:0:8648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b3c00, rc 0) 00000100:00100000:0.0:1784045420.980667:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8364b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2394:x1870706863318656:12345-192.168.203.44@tcp:101:bash.0 Request processed in 710us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045420.980674:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:1.0:1784045420.992013:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045420.992061:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863318784 00000100:00100000:0.0:1784045420.992071:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863318784 00000100:00100000:0.0:1784045420.992132:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:0.0:1784045420.992142:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:12215:x1870706863318784:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1784045420.992158:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045420.992191:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f0bb expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.992401:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba98b27f/0x5475624df454d05b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0b4 expref: 7 pid: 8648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.992411:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045420.992415:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045420.992421:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.992727:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba98b27f/0x5475624df454d05b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0b4 expref: 7 pid: 8648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045420.992743:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba98b27f/0x5475624df454d05b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0b4 expref: 7 pid: 8648 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045420.992757:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1870706873879936:192.168.203.44@tcp:104: 00000100:00100000:0.0:1784045420.992954:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff939ca00233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045421.006733:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8413:1870706873879936:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045421.006769:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.006806:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b2a00, rc 0) 00000100:00100000:2.0:1784045421.006865:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:12215:x1870706863318784:12345-192.168.203.44@tcp:101:bash.0 Request processed in 14724us (14861us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045421.006873:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:0.0:1784045421.008548:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045421.008741:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863318912 00000100:00100000:2.0:1784045421.008751:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863318912 00010000:00010000:2.0:1784045421.008790:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba98b27f/0x5475624df454d05b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0b4 expref: 7 pid: 8648 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045421.008834:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 80 00000100:00100000:2.0:1784045421.008845:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863318912:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045421.008859:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045421.008880:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba98b27f/0x5475624df454d05b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0b4 expref: 7 pid: 8648 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.008894:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba98b27f/0x5475624df454d05b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0b4 expref: 7 pid: 8648 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.008924:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba98b27f/0x5475624df454d05b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0b4 expref: 7 pid: 8648 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.008940:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045421.008944:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045421.008953:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.008986:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.009027:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045421.009043:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83648700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6481:1870706873880064:192.168.203.44@tcp:105: 00000100:00100000:2.0:1784045421.009157:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff939ca1799c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045421.020908:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83648700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6481:1870706873880064:192.168.203.44@tcp:105: 00010000:00010000:2.0:1784045421.020937:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045421.021015:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863318912:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 12171us (12474us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045421.021027:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 80 00000100:00100000:0.0:1784045421.025549:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045421.027503:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863319168 00000100:00100000:2.0:1784045421.027520:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863319168 00000100:00100000:0.0:1784045421.027737:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:0.0:1784045421.027748:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:12215:x1870706863319168:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:0.0:1784045421.028061:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:12215:x1870706863319168:12345-192.168.203.44@tcp:35:bash.0 Request processed in 313us (2519us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1784045421.028070:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:0.0:1784045421.121183:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045421.121859:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863319424 00000100:00100000:1.0:1784045421.121869:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863319424 00000100:00100000:1.0:1784045421.121986:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 158 00000100:00100000:1.0:1784045421.121997:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:12225:x1870706863319424:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1784045421.122021:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045421.122043:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d069 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f0c2 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045421.122137:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1784045421.122238:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d069 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0c2 expref: 23 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.122267:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85200) 00010000:00010000:1.0:1784045421.122271:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045421.122275:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d069 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0c2 expref: 23 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.122289:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cc800, rc 0) 00000100:00100000:1.0:1784045421.122368:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:12225:x1870706863319424:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 365us (1186us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1784045421.122375:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 158 00000100:00100000:2.0:1784045421.124813:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045421.125179:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863319680 00000100:00100000:0.0:1784045421.125189:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863319680 00000100:00100000:0.0:1784045421.125293:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 37 00000100:00100000:0.0:1784045421.125304:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:12225:x1870706863319680:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1784045421.125625:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:12225:x1870706863319680:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 322us (818us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1784045421.125634:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 37 00000100:00100000:2.0:1784045421.226794:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045421.227140:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863319808 00000100:00100000:3.0:1784045421.227151:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863319808 00000100:00100000:3.0:1784045421.227221:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 159 00000100:00100000:3.0:1784045421.227231:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:12231:x1870706863319808:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045421.227262:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045421.227285:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f0c9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.227355:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d07e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.227369:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d07e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.227402:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d07e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045421.227590:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1784045421.227594:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784045421.227615:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d07e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.227641:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0c9 expref: 25 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.227661:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d07e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0c9 expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.227669:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045421.227672:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045421.227676:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80031e00, rc 0) 00000100:00100000:3.0:1784045421.227779:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:12231:x1870706863319808:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 549us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045421.227787:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 159 00000100:00100000:2.0:1784045421.248614:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045421.249114:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863320064 00000100:00100000:0.0:1784045421.249125:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863320064 00000100:00100000:0.0:1784045421.249194:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 160 00000100:00100000:0.0:1784045421.249205:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:12231:x1870706863320064:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1784045421.249226:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045421.249247:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2e00/0x5475624df454d085 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f0d0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.249368:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d08c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.249383:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d08c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.249396:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d08c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045421.249408:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784045421.249572:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2e00/0x5475624df454d085 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0d0 expref: 27 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.249616:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d08c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0d0 expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.249625:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310cd00) 00010000:00010000:0.0:1784045421.249628:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045421.249632:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b2c00, rc 0) 00000100:00100000:0.0:1784045421.249687:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+26:12231:x1870706863320064:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 484us (1084us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1784045421.249695:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 160 00000100:00100000:2.0:1784045421.252817:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045421.252896:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045421.253109:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863320448 00000100:00100000:3.0:1784045421.253118:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863320448 00000100:00100000:3.0:1784045421.253189:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 161 00000100:00100000:3.0:1784045421.253200:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+26:12231:x1870706863320448:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045421.253223:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1784045421.253297:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863320192 00000100:00100000:1.0:1784045421.253302:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863320192 00000100:00100000:1.0:1784045421.253374:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:1.0:1784045421.253381:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:2395:x1870706863320192:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045421.253410:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045421.253434:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d08c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0d0 expref: 27 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.253488:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310cd00) 00010000:00010000:1.0:1784045421.253493:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045421.253552:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+26:2395:x1870706863320192:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 171us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045421.253560:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 12 00010000:00010000:3.0:1784045421.253856:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d09a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f0d7 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.254096:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d0a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.254110:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d0a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.254121:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d0a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045421.254134:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784045421.254235:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d09a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0d7 expref: 28 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.254260:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d0a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0d7 expref: 27 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.254267:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310cd00) 00010000:00010000:3.0:1784045421.254269:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784045421.254272:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80031000, rc 0) 00000100:00100000:3.0:1784045421.254322:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:12231:x1870706863320448:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1124us (1425us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1784045421.254329:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 161 00000100:00100000:3.0:1784045421.258883:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045421.259077:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863320576 00000100:00100000:0.0:1784045421.259089:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863320576 00000100:00100000:0.0:1784045421.259145:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:0.0:1784045421.259155:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2396:x1870706863320576:12345-192.168.203.44@tcp:1:lfs.0 00010000:00010000:0.0:1784045421.259198:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.259218:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.259227:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045421.259231:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784045421.259236:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.259282:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.259313:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 6 pid: 8413 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045421.259329:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1870706873880192:192.168.203.44@tcp:104: 00000100:00100000:0.0:1784045421.259421:0:8411:0:(client.c:2702:ptlrpc_set_wait()) set ffff939ca0023c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045421.263580:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045421.263829:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863320704 00000100:00100000:3.0:1784045421.263839:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863320704 00002000:00100000:3.0:1784045421.263889:0:8419:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff939b82881880 x1870706863320704/t0(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:62/0 lens 504/0 e 0 to 0 dl 1784045432 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784045421.263930:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b82881880 with x1870706863320704 ext(0->12) 00010000:00010000:3.0:1784045421.263940:0:8419:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 7 pid: 8413 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.263957:0:8419:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 7 pid: 8413 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784045421.263964:0:8419:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939b82881880 00000100:00100000:3.0:1784045421.264006:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:3.0:1784045421.264016:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863320704:12345-192.168.203.44@tcp:4:lfs.0 00000100:00100000:0.0:1784045421.264908:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf508000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1870706873880192:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045421.264936:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045421.270886:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2394:x1870706863320704:12345-192.168.203.44@tcp:4:lfs.0 Request processed in 6858us (7301us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784045421.270901:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 2 00002000:00100000:3.0:1784045421.270915:0:8419:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff939b82881880 x1870706863320704/t4294967306(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:62/0 lens 504/448 e 0 to 0 dl 1784045432 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784045421.270926:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b82881880 with x1870706863320704 ext(0->12) 00010000:00010000:3.0:1784045421.270936:0:8419:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 9 pid: 8413 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.270957:0:8419:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 9 pid: 8413 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784045421.270966:0:8419:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939b82881880 00000100:00100000:0.0:1784045421.280546:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045421.280622:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863320832 00000100:00100000:1.0:1784045421.280633:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863320832 00010000:00010000:1.0:1784045421.280672:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 9 pid: 8413 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045421.280721:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 81 00000100:00100000:1.0:1784045421.280730:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2395:x1870706863320832:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045421.280748:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784045421.280766:0:9500:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784045421.280769:0:9500:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1784045420 00002000:00010000:1.0:1784045421.280771:0:9500:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1784045420 00002000:00010000:1.0:1784045421.280773:0:9500:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1784045420 00002000:00010000:1.0:1784045421.280775:0:9500:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1784045421.280781:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 9 pid: 8413 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.280795:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 9 pid: 8413 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.280838:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007233a325/0x5475624df454d062 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0bb expref: 9 pid: 8413 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.280857:0:9500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045421.280862:0:9500:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784045421.280869:0:9500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.280879:0:9500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.281317:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045421.281439:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.281484:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.281507:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.281524:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.281532:0:8411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.281554:0:8411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2600 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:0.0:1784045421.281559:0:8411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.281568:0:8411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.281580:0:8411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.281587:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d340aa6/0x5475624df454d0af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045421.282196:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf508000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2395:x1870706863320832:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 1461us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045421.282206:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 81 00000100:00100000:0.0:1784045421.284208:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2396:x1870706863320576:12345-192.168.203.44@tcp:1:lfs.0 Request processed in 25041us (25323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045421.284224:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:1.0:1784045421.289861:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045421.289932:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863321088 00000100:00100000:3.0:1784045421.289955:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863321088 00000100:00100000:3.0:1784045421.290050:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:3.0:1784045421.290061:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9855f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:12231:x1870706863321088:12345-192.168.203.44@tcp:35:lfs.0 00000004:00010000:3.0:1784045421.290125:0:6499:0:(mdt_open.c:1993:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d0a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0d7 expref: 27 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045421.290320:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1784045421.290354:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1784045421.290961:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1784045421.291064:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.291081:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d04d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ad expref: 31 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.291091:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.291127:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d04d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ad expref: 31 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.291142:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d04d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ad expref: 31 pid: 10615 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045421.291156:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1870706873880320:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045421.291263:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c83dfbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045421.298810:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045421.298938:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863321216 00000100:00100000:1.0:1784045421.298947:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863321216 00010000:00010000:1.0:1784045421.298986:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d04d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ad expref: 32 pid: 10615 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045421.299026:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 82 00000100:00100000:1.0:1784045421.299036:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+32:2394:x1870706863321216:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045421.299052:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045421.299059:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d04d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ad expref: 32 pid: 10615 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.299089:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d04d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ad expref: 32 pid: 10615 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.299112:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310cd00) 00010000:00010000:1.0:1784045421.299117:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.299125:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.299132:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.299151:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045421.299206:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+32:2394:x1870706863321216:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 170us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045421.299213:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 82 00010000:00010000:3.0:1784045421.300387:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d04d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ad expref: 31 pid: 10615 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045421.300429:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6499:1870706873880320:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045421.300478:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.300488:0:6499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.300494:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045421.300606:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1784045421.300707:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1784045421.300787:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1870706873880448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784045421.300842:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045421.300880:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c82469e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045421.301060:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873880448 00000100:00100000:2.0:1784045421.301068:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873880448 00000100:00100000:2.0:1784045421.301117:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1784045421.301135:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1870706873880448:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784045421.301217:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6499:x1870706873880448:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045421.301224:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784045421.301316:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1870706873880448:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784045421.301418:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1784045421.301596:0:6499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1870706873880576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784045421.301625:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045421.301687:0:6499:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c811ca900 going to sleep for 11 seconds 00000100:00080000:1.0:1784045421.301744:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784045421.301869:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873880576 00000100:00100000:2.0:1784045421.301874:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873880576 00000100:00100000:2.0:1784045421.302000:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784045421.302009:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6499:x1870706873880576:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784045421.302119:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6499:x1870706873880576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 111us (493us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784045421.302126:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1784045421.302181:0:6499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6499:1870706873880576:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784045421.302218:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1784045421.302247:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.302268:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.302285:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.302292:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045421.302296:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.302304:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.302319:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310cd00) 00010000:00010000:3.0:1784045421.302322:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784045421.302326:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.302333:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0b6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784045421.302419:0:6499:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784045421.302507:0:6499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1784045421.302532:0:6499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377411086915ns, next at 378411084936ns, rc = 0 00000001:00080000:3.0:1784045421.302538:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1784045421.302561:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310cd00) 00010000:00010000:3.0:1784045421.302564:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784045421.302570:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d0a1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0d7 expref: 35 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045421.302668:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9855f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+34:12231:x1870706863321088:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 12609us (12819us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1784045421.302686:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 38 00000020:00080000:3.0:1784045421.302690:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1784045421.304804:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045421.304916:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863321344 00000100:00100000:1.0:1784045421.304924:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863321344 00000100:00100000:1.0:1784045421.304980:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 162 00000100:00100000:1.0:1784045421.304991:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+34:12231:x1870706863321344:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1784045421.305012:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045421.305036:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d0bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f0de expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.305090:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d0bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0de expref: 35 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.305116:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d0bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0de expref: 35 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.305137:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:1.0:1784045421.305140:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045421.305144:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cda00, rc 0) 00000100:00100000:1.0:1784045421.305194:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+35:12231:x1870706863321344:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 205us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045421.305201:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 162 00000100:00100000:1.0:1784045421.312791:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045421.313115:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863321600 00000100:00100000:2.0:1784045421.313128:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863321600 00000100:00100000:2.0:1784045421.313216:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:2.0:1784045421.313226:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+35:12231:x1870706863321600:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:2.0:1784045421.313490:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+36:12231:x1870706863321600:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 264us (706us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1784045421.313498:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:1.0:1784045421.394061:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045421.394212:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863321856 00000100:00100000:0.0:1784045421.394222:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863321856 00000100:00100000:0.0:1784045421.394290:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 163 00000100:00100000:0.0:1784045421.394300:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+36:12241:x1870706863321856:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1784045421.394323:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045421.394345:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2e00/0x5475624df454d0c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f0e5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045421.394441:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1784045421.394616:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2e00/0x5475624df454d0c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0e5 expref: 38 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.394631:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85200) 00010000:00010000:0.0:1784045421.394634:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784045421.394639:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2e00/0x5475624df454d0c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0e5 expref: 38 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.394652:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b2e00, rc 0) 00000100:00100000:0.0:1784045421.394703:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+37:12241:x1870706863321856:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 405us (654us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1784045421.394712:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 163 00000100:00100000:0.0:1784045421.397716:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045421.397809:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863321984 00000100:00100000:2.0:1784045421.397819:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863321984 00000100:00100000:2.0:1784045421.397876:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 164 00000100:00100000:2.0:1784045421.397887:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+37:12241:x1870706863321984:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:2.0:1784045421.397984:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d0d2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398003:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d0d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398033:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d0d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398047:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d0d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398055:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398062:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398141:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d0e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398149:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398156:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045421.398205:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398218:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d0d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398225:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d0d2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398233:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d0d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398261:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045421.398265:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d0d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398273:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d0d2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398286:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:2.0:1784045421.398289:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045421.398293:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d0d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398300:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d0d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398314:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d0d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398320:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d0d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398326:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d0d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398331:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045421.398334:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d0d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398341:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d0d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398361:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c900) 00010000:00010000:2.0:1784045421.398363:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045421.398367:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d0d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398373:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d0d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398384:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398390:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d0e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398396:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398401:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2170a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045421.398404:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398410:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d0e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398417:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:2.0:1784045421.398419:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045421.398421:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d0e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.398426:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d0e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045421.398563:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+37:12241:x1870706863321984:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 676us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045421.398571:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 164 00000100:00100000:2.0:1784045421.401398:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045421.401541:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863322240 00000100:00100000:3.0:1784045421.401551:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863322240 00000100:00100000:3.0:1784045421.401607:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:3.0:1784045421.401617:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+37:12241:x1870706863322240:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1784045421.401830:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:12241:x1870706863322240:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 213us (440us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1784045421.401838:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:0.0:1784045421.433377:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045421.433558:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863322496 00000100:00100000:3.0:1784045421.433567:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863322496 00000100:00100000:3.0:1784045421.433630:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 165 00000100:00100000:3.0:1784045421.433641:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:12244:x1870706863322496:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045421.433665:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045421.433688:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d0e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f0ec expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.433766:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.433781:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.433793:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.433805:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d0f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.433828:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.433835:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.433950:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d0fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.433959:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d0fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.433967:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d0fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045421.434190:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784045421.434431:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434440:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0ee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434588:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434595:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045421.434599:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434606:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434632:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045421.434635:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045421.434640:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434646:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d0ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434661:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434667:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d0f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434673:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434678:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045421.434681:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434687:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d0f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434694:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c900) 00010000:00010000:3.0:1784045421.434696:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045421.434699:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d0f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434705:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d0f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434759:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d0e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ec expref: 41 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434774:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d0fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ec expref: 40 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.434781:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:3.0:1784045421.434783:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045421.434786:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80031c00, rc 0) 00000100:00100000:3.0:1784045421.434901:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+40:12244:x1870706863322496:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1262us (1534us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1784045421.434909:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 165 00000100:00100000:0.0:1784045421.443626:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045421.443862:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863322624 00000100:00100000:1.0:1784045421.443872:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863322624 00000100:00100000:1.0:1784045421.444067:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 166 00000100:00100000:1.0:1784045421.444079:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c8820ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+40:12244:x1870706863322624:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:1.0:1784045421.444149:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d10a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.444166:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d10a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.444178:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d10a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.444213:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d10a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.444219:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d10a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.444242:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d10a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.444258:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045421.444263:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d10a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.444270:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d10a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.444282:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:1.0:1784045421.444285:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045421.444290:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d10a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.444306:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d10a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045421.444387:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c8820ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+40:12244:x1870706863322624:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 311us (4990us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045421.444395:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 166 00000100:00100000:2.0:1784045421.448047:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045421.448140:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863322880 00000100:00100000:3.0:1784045421.448149:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863322880 00000100:00100000:3.0:1784045421.448237:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:3.0:1784045421.448256:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+40:12244:x1870706863322880:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1784045421.449124:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+41:12244:x1870706863322880:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 874us (1080us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1784045421.449132:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 41 00010000:00010000:0.0:1784045421.524157:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045421.795307:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045421.795419:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863323136 00000100:00100000:2.0:1784045421.795430:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863323136 00000100:00100000:2.0:1784045421.795532:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 167 00000100:00100000:2.0:1784045421.795544:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+41:12275:x1870706863323136:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:2.0:1784045421.795575:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045421.795597:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d111 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f0f3 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.795706:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d118 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.795722:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.795735:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045421.795745:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784045421.795888:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d111 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0f3 expref: 44 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.795908:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d118 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0f3 expref: 43 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.795938:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:2.0:1784045421.795942:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045421.795945:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171400, rc 0) 00000100:00100000:2.0:1784045421.796020:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf546d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+43:12275:x1870706863323136:12345-192.168.203.44@tcp:101:cat.0 Request processed in 479us (721us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1784045421.796027:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 167 00000100:00100000:0.0:1784045421.804819:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045421.805033:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863323264 00000100:00100000:2.0:1784045421.805045:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863323264 00000100:00100000:2.0:1784045421.805119:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:2.0:1784045421.805130:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+43:2395:x1870706863323264:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045421.805147:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045421.805172:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d118 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0f3 expref: 43 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.805191:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:2.0:1784045421.805196:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045421.805263:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf544000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+42:2395:x1870706863323264:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 135us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045421.805270:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:1.0:1784045421.811754:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045421.811863:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863323520 00000100:00100000:2.0:1784045421.811875:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863323520 00000100:00100000:2.0:1784045421.811937:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:2.0:1784045421.811947:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+42:12275:x1870706863323520:12345-192.168.203.44@tcp:35:cat.0 00000100:00100000:2.0:1784045421.812158:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+43:12275:x1870706863323520:12345-192.168.203.44@tcp:35:cat.0 Request processed in 212us (414us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1784045421.812176:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:0.0:1784045421.879410:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045421.879539:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863323776 00000100:00100000:3.0:1784045421.879549:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863323776 00000100:00100000:3.0:1784045421.879617:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 168 00000100:00100000:3.0:1784045421.879627:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+43:12281:x1870706863323776:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:3.0:1784045421.879652:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045421.879656:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784045421.879700:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d07e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0c9 expref: 43 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.879719:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045421.879724:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045421.879738:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d126 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f0fa expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.879866:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.879879:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d0fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ec expref: 43 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.879888:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.879922:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d0fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ec expref: 43 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045421.879934:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d0fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ec expref: 43 pid: 6497 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045421.879957:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b835b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873880704:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045421.880061:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c829cf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045421.883409:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b835b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873880704:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045421.883437:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045421.884428:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045421.884924:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863323904 00000100:00100000:1.0:1784045421.884932:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863323904 00010000:00010000:1.0:1784045421.885239:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d0fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ec expref: 44 pid: 6497 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045421.885327:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 83 00000100:00100000:1.0:1784045421.885337:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe48450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+44:2394:x1870706863323904:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045421.885364:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045421.885371:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d0fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ec expref: 44 pid: 6497 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.885383:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d0fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ec expref: 44 pid: 6497 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.885405:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d0fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0ec expref: 44 pid: 6497 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.885424:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:1.0:1784045421.885428:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.885438:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.885497:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045421.885531:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045421.885581:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe48450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+43:2394:x1870706863323904:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 246us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045421.885589:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 83 00010000:00010000:0.0:1784045421.885685:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.885692:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045421.885710:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784045421.885851:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d126 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0fa expref: 44 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.885879:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0fa expref: 43 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045421.885887:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:0.0:1784045421.885889:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784045421.885892:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030c00, rc 0) 00000100:00100000:0.0:1784045421.885916:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf545180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+43:12281:x1870706863323776:12345-192.168.203.44@tcp:101:dd.0 Request processed in 6291us (6515us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1784045421.885923:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 168 00000100:00100000:0.0:1784045421.890263:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045421.890364:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863324032 00000100:00100000:2.0:1784045421.890375:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863324032 00000100:00100000:2.0:1784045421.890476:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 169 00000100:00100000:2.0:1784045421.890487:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+43:12281:x1870706863324032:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:2.0:1784045421.890517:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045421.890537:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d13b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f101 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.890786:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d142 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.890811:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.890824:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.891123:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d13b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f101 expref: 45 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.891143:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f101 expref: 44 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.891151:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:2.0:1784045421.891154:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784045421.891158:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc2171000, rc 0) 00000100:00100000:2.0:1784045421.891271:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+44:12281:x1870706863324032:12345-192.168.203.44@tcp:101:dd.0 Request processed in 786us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045421.891286:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 169 00000100:00100000:0.0:1784045421.896114:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045421.896202:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863324288 00000100:00100000:2.0:1784045421.896213:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863324288 00000100:00100000:2.0:1784045421.896283:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 170 00000100:00100000:2.0:1784045421.896294:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+44:12281:x1870706863324288:12345-192.168.203.44@tcp:36:dd.0 00010000:00010000:2.0:1784045421.896566:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454d149 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.896583:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454d149 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.896597:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454d149 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045421.896638:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1784045421.896661:0:6498:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000097f54dc6 reply state 00000000e278bdf6 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454d149 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.896673:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454d149 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045421.896680:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:2.0:1784045421.896683:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784045421.896687:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784045421.896776:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+47:12281:x1870706863324288:12345-192.168.203.44@tcp:36:dd.0 Request processed in 484us (670us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1784045421.896784:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 170 00000020:00080000:2.0:1784045421.896788:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784045422.111052:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045422.111226:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863324416 00000100:00100000:3.0:1784045422.111236:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863324416 00000100:00100000:3.0:1784045422.111322:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 171 00000100:00100000:3.0:1784045422.111333:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+47:12295:x1870706863324416:12345-192.168.203.44@tcp:101:stat.0 00010000:00010000:3.0:1784045422.111354:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045422.111375:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d150 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f108 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.111437:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d157 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.111489:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d157 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.111500:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d157 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.111511:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d15e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.111518:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d15e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.111525:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d15e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.111593:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d165 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.111603:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0fa expref: 48 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.111628:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d165 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.111660:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0fa expref: 48 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.111673:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0fa expref: 48 pid: 6496 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045422.111687:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b835b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873880832:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045422.111784:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c829cf3c0 going to sleep for 11 seconds 00000100:00080000:1.0:1784045422.111893:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045422.115760:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045422.115893:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b835b6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873880832:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045422.115929:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d165 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045422.117112:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863324672 00000100:00100000:2.0:1784045422.117123:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863324672 00000100:00100000:2.0:1784045422.117237:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:2.0:1784045422.117609:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+49:6164:x1870706863324672:12345-192.168.203.44@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784045422.118257:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+50:6164:x1870706863324672:12345-192.168.203.44@tcp:35:ldlm_bl.0 Request processed in 1009us (2504us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1784045422.118265:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:0.0:1784045422.124919:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045422.125032:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863324800 00000100:00100000:1.0:1784045422.125041:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863324800 00010000:00010000:1.0:1784045422.125081:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0fa expref: 50 pid: 6496 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045422.125149:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 84 00000100:00100000:1.0:1784045422.125158:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+50:2394:x1870706863324800:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045422.125175:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045422.125181:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0fa expref: 50 pid: 6496 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045422.125195:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0fa expref: 50 pid: 6496 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045422.125218:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d12d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f0fa expref: 50 pid: 6496 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045422.125236:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:1.0:1784045422.125240:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d165 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045422.125262:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045422.125269:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d165 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045422.125302:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045422.125357:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+49:2394:x1870706863324800:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 200us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045422.125365:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 84 00010000:00010000:3.0:1784045422.125842:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.125853:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045422.125908:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784045422.125912:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784045422.125931:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.125944:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.125954:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d157 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.125974:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d157 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.125980:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d157 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.125986:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045422.125990:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d157 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.125997:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d157 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.126009:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045422.126012:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045422.126016:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d157 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.126023:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d157 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.126036:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d15e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.126042:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d15e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.126047:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d15e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.126051:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045422.126060:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d15e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.126066:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d15e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.126074:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c900) 00010000:00010000:3.0:1784045422.126076:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045422.126079:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d15e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.126084:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d15e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.126117:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d150 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f108 expref: 49 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.126132:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d165 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f108 expref: 48 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.126138:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:3.0:1784045422.126140:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045422.126142:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80031000, rc 0) 00000100:00100000:3.0:1784045422.126191:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+48:12295:x1870706863324416:12345-192.168.203.44@tcp:101:stat.0 Request processed in 14861us (15148us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045422.126198:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 171 00000100:00100000:0.0:1784045422.208131:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045422.208430:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863325056 00000100:00100000:2.0:1784045422.208440:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863325056 00000100:00100000:2.0:1784045422.208526:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 172 00000100:00100000:2.0:1784045422.208536:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+48:12301:x1870706863325056:12345-192.168.203.44@tcp:36:truncate.0 00010000:00010000:2.0:1784045422.208592:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045422.208617:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d165 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f108 expref: 48 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.208638:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:2.0:1784045422.208643:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045422.209101:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d16c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.209117:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d16c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.209127:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d16c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045422.209170:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1784045422.209193:0:6498:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf3f358d reply state 00000000bb249a68 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d16c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.209206:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d16c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.209228:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:2.0:1784045422.209231:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784045422.209234:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784045422.209340:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+50:12301:x1870706863325056:12345-192.168.203.44@tcp:36:truncate.0 Request processed in 804us (1216us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1784045422.209349:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 172 00000020:00080000:2.0:1784045422.209354:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784045422.227786:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045422.227840:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc10fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873880960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045422.228269:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784045422.228292:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b830f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873881088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045422.228332:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045422.228524:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873881088 00000100:00100000:2.0:1784045422.228535:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873881088 00000100:00100000:2.0:1784045422.228606:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784045422.228616:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873881088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045422.228646:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784045422.228692:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873881088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045422.228699:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1784045422.228824:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045422.228862:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b830f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873881088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045422.229079:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045422.229274:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873880960 00000100:00100000:2.0:1784045422.229293:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873880960 00000100:00100000:2.0:1784045422.229337:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784045422.229344:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b833ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873880960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784045422.229357:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1784045422.229398:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b833ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873880960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045422.229403:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784045422.229434:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc10fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873880960:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784045422.229624:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045422.425803:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045422.426186:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863325184 00000100:00100000:2.0:1784045422.426196:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863325184 00000100:00100000:2.0:1784045422.426343:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 173 00000100:00100000:2.0:1784045422.426355:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+50:12315:x1870706863325184:12345-192.168.203.44@tcp:101:stat.0 00010000:00010000:2.0:1784045422.426380:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045422.426405:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454d173 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f10f expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426526:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d17a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426542:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d17a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426552:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d17a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426562:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d181 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426569:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d181 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426575:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d181 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426643:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d188 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426652:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426658:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045422.426708:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1784045422.426713:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045422.426732:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426745:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d188 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426753:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d17a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426759:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d17a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426765:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d17a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426771:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045422.426775:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d17a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426783:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d17a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426794:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:2.0:1784045422.426797:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045422.426801:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d17a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426807:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171400/0x5475624df454d17a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426830:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d181 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426837:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d181 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426842:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d181 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426848:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2170a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045422.426851:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d181 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426856:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d181 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426864:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c900) 00010000:00010000:2.0:1784045422.426867:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045422.426870:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d181 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426876:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170a00/0x5475624df454d181 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426912:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170000/0x5475624df454d173 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f10f expref: 52 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426926:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d188 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f10f expref: 51 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.426944:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:2.0:1784045422.426947:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045422.426949:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986200, rc 0) 00000100:00100000:2.0:1784045422.427676:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+51:12315:x1870706863325184:12345-192.168.203.44@tcp:101:stat.0 Request processed in 1318us (1878us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045422.427685:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 173 00000100:00100000:1.0:1784045422.513931:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045422.514169:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863325440 00000100:00100000:2.0:1784045422.514179:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863325440 00000100:00100000:2.0:1784045422.514251:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 174 00000100:00100000:2.0:1784045422.514261:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+51:12325:x1870706863325440:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045422.514280:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045422.514299:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d18f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f116 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045422.514392:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1784045422.519459:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d18f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f116 expref: 53 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.519481:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85200) 00010000:00010000:2.0:1784045422.519484:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045422.519489:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d18f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f116 expref: 53 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.519515:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987800, rc 0) 00000100:00100000:2.0:1784045422.519596:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+52:12325:x1870706863325440:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 5336us (5673us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1784045422.519625:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 174 00000100:00100000:0.0:1784045422.524395:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045422.524659:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863325696 00000100:00100000:3.0:1784045422.524669:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863325696 00000100:00100000:3.0:1784045422.524767:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:3.0:1784045422.524777:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9855d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+52:12325:x1870706863325696:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1784045422.525037:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9855d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+53:12325:x1870706863325696:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 261us (650us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1784045422.525045:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 44 00010000:00010000:1.0:1784045422.550738:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045422.577816:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045422.577906:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863325952 00000100:00100000:3.0:1784045422.577915:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863325952 00000100:00100000:3.0:1784045422.578119:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 175 00000100:00100000:3.0:1784045422.578131:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+53:12331:x1870706863325952:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1784045422.578157:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045422.578180:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d19d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f11d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.578294:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.578311:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d188 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f10f expref: 54 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.578326:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.578360:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d188 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f10f expref: 54 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.578372:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d188 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f10f expref: 54 pid: 10615 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045422.578387:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873881216:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045422.578547:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff939ca1799c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784045422.583639:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045422.584026:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873881216:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045422.584053:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045422.585214:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863326080 00000100:00100000:2.0:1784045422.585225:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863326080 00010000:00010000:2.0:1784045422.585284:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d188 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f10f expref: 55 pid: 10615 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045422.585334:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 85 00000100:00100000:2.0:1784045422.585344:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+55:2394:x1870706863326080:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045422.585361:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045422.585368:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d188 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f10f expref: 55 pid: 10615 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.585381:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d188 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f10f expref: 55 pid: 10615 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.585405:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d188 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f10f expref: 55 pid: 10615 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.585421:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:2.0:1784045422.585427:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.585438:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.585506:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.585551:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045422.585621:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+54:2394:x1870706863326080:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 277us (1990us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045422.585630:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 85 00010000:00010000:0.0:1784045422.585777:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.585796:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045422.585815:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1784045422.585966:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d19d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f11d expref: 55 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.585985:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f11d expref: 54 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.585993:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:0.0:1784045422.585995:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784045422.585998:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030e00, rc 0) 00000100:00100000:0.0:1784045422.586026:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+54:12331:x1870706863325952:12345-192.168.203.44@tcp:101:bash.0 Request processed in 7898us (8219us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1784045422.586033:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 175 00000100:00100000:0.0:1784045422.591843:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045422.591937:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863326336 00000100:00100000:3.0:1784045422.591958:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863326336 00000100:00100000:3.0:1784045422.592023:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 176 00000100:00100000:3.0:1784045422.592033:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+54:12331:x1870706863326336:12345-192.168.203.44@tcp:36:bash.0 00010000:00010000:3.0:1784045422.592264:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d1b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.592281:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.592293:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045422.592336:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1784045422.592360:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fcd37f5 reply state 0000000069c826d5 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d1b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.592372:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d1b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.592380:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:3.0:1784045422.592383:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784045422.592387:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045422.593390:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+57:12331:x1870706863326336:12345-192.168.203.44@tcp:36:bash.0 Request processed in 1354us (1552us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1784045422.593418:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 176 00000020:00080000:3.0:1784045422.593423:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784045422.600818:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045422.600945:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863326464 00000100:00100000:2.0:1784045422.600954:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863326464 00000100:00100000:2.0:1784045422.601018:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 177 00000100:00100000:2.0:1784045422.601026:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+57:12331:x1870706863326464:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1784045422.601047:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045422.601065:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d1b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f124 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.601151:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d1c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.601167:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f11d expref: 58 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.601177:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d1c0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.601208:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f11d expref: 58 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.601219:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f11d expref: 58 pid: 6497 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045422.601233:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b830f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873881344:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045422.601704:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92daac00 going to sleep for 11 seconds 00000100:00100000:1.0:1784045422.607370:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045422.607500:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b830f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873881344:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045422.607535:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d1c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045422.607786:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863326592 00000100:00100000:3.0:1784045422.607794:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863326592 00010000:00010000:3.0:1784045422.607829:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f11d expref: 59 pid: 6497 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045422.607874:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 86 00000100:00100000:3.0:1784045422.607883:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+59:2395:x1870706863326592:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045422.607897:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045422.607904:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f11d expref: 59 pid: 6497 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.607916:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f11d expref: 59 pid: 6497 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.607948:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f11d expref: 59 pid: 6497 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.607966:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:3.0:1784045422.607984:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d1c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.607993:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.608001:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d1c0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.608046:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045422.608102:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+58:2395:x1870706863326592:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 219us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045422.608109:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 86 00010000:00010000:2.0:1784045422.608201:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.608214:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045422.608274:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784045422.608279:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045422.608299:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d1c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.608330:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d1b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f124 expref: 58 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.608344:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d1c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f124 expref: 57 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.608352:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:2.0:1784045422.608354:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045422.608356:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987800, rc 0) 00000100:00100000:2.0:1784045422.608385:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+57:12331:x1870706863326464:12345-192.168.203.44@tcp:101:bash.0 Request processed in 7360us (7575us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045422.608392:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 177 00000100:00100000:0.0:1784045422.612420:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045422.612622:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863326848 00000100:00100000:2.0:1784045422.612648:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863326848 00000100:00100000:2.0:1784045422.612703:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:2.0:1784045422.612713:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+57:12331:x1870706863326848:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:2.0:1784045422.612952:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+58:12331:x1870706863326848:12345-192.168.203.44@tcp:35:bash.0 Request processed in 239us (540us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1784045422.612960:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:1.0:1784045422.732125:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045422.732591:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863327104 00000100:00100000:2.0:1784045422.732601:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863327104 00000100:00100000:2.0:1784045422.732661:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 178 00000100:00100000:2.0:1784045422.732670:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+58:12341:x1870706863327104:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045422.732693:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045422.732713:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d1c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f12b expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045422.732820:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1784045422.733232:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d1c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f12b expref: 60 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.733258:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85200) 00010000:00010000:2.0:1784045422.733262:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045422.733268:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d1c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f12b expref: 60 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.733286:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986200, rc 0) 00000100:00100000:2.0:1784045422.733430:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+59:12341:x1870706863327104:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 760us (1314us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1784045422.733438:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 178 00000100:00100000:2.0:1784045422.739779:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045422.739813:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873881472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045422.739917:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045422.740297:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873881472 00000100:00100000:3.0:1784045422.740308:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873881472 00000100:00100000:3.0:1784045422.740405:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784045422.740417:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873881472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045422.740528:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045422.740607:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873881472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 192us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045422.740615:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1784045422.741024:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c915c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873881472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784045422.763036:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045422.763341:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863327232 00000100:00100000:0.0:1784045422.763352:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863327232 00000100:00100000:0.0:1784045422.763730:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 179 00000100:00100000:0.0:1784045422.763741:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+59:12341:x1870706863327232:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:0.0:1784045422.763824:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d1d5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764229:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764266:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764279:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454d1dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764286:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454d1dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764469:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454d1dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764550:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454d1e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764560:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454d1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764567:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454d1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045422.764617:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454d1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764629:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d1d5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764636:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d1d5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764643:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764660:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045422.764664:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d1d5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764671:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d1d5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764683:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:0.0:1784045422.764686:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045422.764691:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d1d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764697:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d1d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764710:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454d1dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764716:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454d1dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764721:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454d1dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764726:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045422.764729:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454d1dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764735:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454d1dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764753:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c900) 00010000:00010000:0.0:1784045422.764756:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045422.764760:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454d1dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764765:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2800/0x5475624df454d1dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764776:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454d1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764782:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454d1e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.764787:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454d1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.765172:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045422.765177:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454d1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.765184:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454d1e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.765193:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:0.0:1784045422.765195:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045422.765197:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454d1e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045422.765203:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2600/0x5475624df454d1e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045422.773603:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+59:12341:x1870706863327232:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 9850us (10562us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045422.773619:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 179 00000100:00100000:0.0:1784045422.788618:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045422.789008:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863327488 00000100:00100000:2.0:1784045422.789022:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863327488 00000100:00100000:2.0:1784045422.789096:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:2.0:1784045422.789108:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+59:12341:x1870706863327488:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:2.0:1784045422.790019:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:12341:x1870706863327488:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 903us (1412us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1784045422.790031:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:1.0:1784045422.867056:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045422.867172:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863327744 00000100:00100000:3.0:1784045422.867185:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863327744 00000100:00100000:3.0:1784045422.867269:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 180 00000100:00100000:3.0:1784045422.867282:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:12344:x1870706863327744:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045422.867317:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045422.867356:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f132 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867490:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d1f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867508:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867522:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867555:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d1f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867562:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867569:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867711:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d1ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867721:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d1ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867729:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d1ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045422.867742:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784045422.867843:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867864:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d1f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867870:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867877:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045422.867882:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867901:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d1f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867915:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045422.867918:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045422.867923:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d1f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867929:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d1f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867946:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867953:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867959:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867964:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045422.867967:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867972:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d1f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.867980:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c900) 00010000:00010000:3.0:1784045422.867982:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045422.867985:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d1f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.868003:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d1f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.868053:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d1ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f132 expref: 63 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.868069:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d1ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f132 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.868077:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:3.0:1784045422.868080:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045422.868082:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80031000, rc 0) 00000100:00100000:3.0:1784045422.868173:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+62:12344:x1870706863327744:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 894us (1132us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1784045422.868182:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 180 00000100:00100000:1.0:1784045422.882895:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045422.883361:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045422.883430:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863328000 00000100:00100000:3.0:1784045422.883480:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863328000 00000100:00100000:3.0:1784045422.883554:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 181 00000100:00100000:3.0:1784045422.883566:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+62:12344:x1870706863328000:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:3.0:1784045422.883660:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d20d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.883686:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d20d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.883700:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d20d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.883766:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d20d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.883774:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d20d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.883781:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d20d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.883788:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045422.883792:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d20d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.883800:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d20d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.883814:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:3.0:1784045422.883818:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045422.883822:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d20d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045422.883830:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d20d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045422.884004:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+62:12344:x1870706863328000:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 438us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045422.884014:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 181 00000100:00100000:0.0:1784045422.891564:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045422.891574:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863327872 00000100:00100000:2.0:1784045422.891590:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863327872 00000100:00100000:2.0:1784045422.891677:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:2.0:1784045422.891700:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+62:2394:x1870706863327872:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045422.891727:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045422.891759:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d1ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f132 expref: 62 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045422.891784:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:2.0:1784045422.891790:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045422.891868:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+61:2394:x1870706863327872:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 180us (8985us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045422.891877:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:1.0:1784045422.892673:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863328256 00000100:00100000:1.0:1784045422.892681:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863328256 00000100:00100000:1.0:1784045422.892796:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:1.0:1784045422.892806:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+61:12344:x1870706863328256:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:1.0:1784045422.893284:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+62:12344:x1870706863328256:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 477us (1733us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1784045422.893293:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:0.0:1784045423.112016:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.112234:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863328512 00000100:00100000:3.0:1784045423.112254:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863328512 00000100:00100000:3.0:1784045423.112333:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 182 00000100:00100000:3.0:1784045423.112364:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+62:12362:x1870706863328512:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:3.0:1784045423.112409:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045423.112438:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d214 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f139 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.112793:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d21b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.112812:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d21b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.112828:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d21b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045423.112843:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784045423.112980:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d214 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f139 expref: 65 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.113002:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d21b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f139 expref: 64 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.113012:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:3.0:1784045423.113016:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784045423.113020:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030e00, rc 0) 00000100:00100000:3.0:1784045423.113335:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+64:12362:x1870706863328512:12345-192.168.203.44@tcp:101:cat.0 Request processed in 972us (1331us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1784045423.113343:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 182 00000100:00100000:3.0:1784045423.150690:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045423.151127:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863328640 00000100:00100000:2.0:1784045423.151141:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863328640 00000100:00100000:2.0:1784045423.151236:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 183 00000100:00100000:2.0:1784045423.151256:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c915c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+64:12363:x1870706863328640:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045423.151289:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045423.151315:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d229 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f140 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045423.151474:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d230 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045423.151492:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045423.151506:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045423.151566:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784045423.151571:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045423.151596:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045423.151628:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d229 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f140 expref: 66 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045423.151648:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d230 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f140 expref: 65 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045423.151659:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:2.0:1784045423.151662:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045423.151674:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987200, rc 0) 00000100:00100000:2.0:1784045423.151761:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c915c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:12363:x1870706863328640:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 508us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045423.151769:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 183 00000100:00100000:0.0:1784045423.157369:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045423.164358:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863329024 00000100:00100000:2.0:1784045423.164379:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863329024 00000100:00100000:2.0:1784045423.164489:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 48 00000100:00100000:2.0:1784045423.164503:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:12363:x1870706863329024:12345-192.168.203.44@tcp:35:lfs.0 00000001:00080000:2.0:1784045423.164801:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967458 00000100:00100000:2.0:1784045423.164954:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:12363:x1870706863329024:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 453us (7592us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1784045423.164963:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 48 00000020:00080000:2.0:1784045423.164968:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784045423.167892:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045423.168012:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863329152 00000100:00100000:1.0:1784045423.168032:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863329152 00000100:00100000:1.0:1784045423.168143:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:1.0:1784045423.168155:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:12363:x1870706863329152:12345-192.168.203.44@tcp:103:lfs.0 00010000:00010000:1.0:1784045423.168175:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784045423.168228:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d1c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f124 expref: 67 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.168270:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d21b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f139 expref: 66 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.168288:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d0bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0de expref: 65 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.168301:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:1.0:1784045423.168307:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045423.168397:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+64:12363:x1870706863329152:12345-192.168.203.44@tcp:103:lfs.0 Request processed in 243us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045423.168405:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:2.0:1784045423.172722:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045423.172827:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863329280 00000100:00100000:1.0:1784045423.172838:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863329280 00000100:00100000:1.0:1784045423.172909:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 184 00000100:00100000:1.0:1784045423.172921:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+64:12363:x1870706863329280:12345-192.168.203.44@tcp:58:lfs.0 00010000:00010000:1.0:1784045423.173048:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d237 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.173067:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d237 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.173078:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d237 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784045423.173173:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1784045423.173272:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+64:12363:x1870706863329280:12345-192.168.203.44@tcp:58:lfs.0 Request processed in 352us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045423.173307:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 184 00000100:00100000:2.0:1784045423.204761:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.204941:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863329408 00000100:00100000:3.0:1784045423.204950:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863329408 00000100:00100000:3.0:1784045423.205307:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 185 00000100:00100000:3.0:1784045423.205318:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+64:12365:x1870706863329408:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045423.205338:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045423.205361:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d23e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f147 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205430:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d245 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205627:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d245 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205642:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d245 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205655:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d24c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205663:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d24c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205669:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d24c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205740:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d253 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205749:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205773:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045423.205816:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784045423.205821:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784045423.205840:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205852:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205860:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d245 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205867:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d245 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205873:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d245 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205880:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045423.205884:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d245 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.205891:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d245 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.206036:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045423.206040:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045423.206045:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d245 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.206062:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d245 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.206079:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d24c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.206085:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d24c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.206092:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d24c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.206098:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045423.206102:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d24c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.206108:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d24c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.206117:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c900) 00010000:00010000:3.0:1784045423.206119:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045423.206122:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d24c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.206129:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d24c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.206159:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d23e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f147 expref: 66 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.206188:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d253 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f147 expref: 65 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.206195:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:3.0:1784045423.206198:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045423.206200:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030e00, rc 0) 00000100:00100000:3.0:1784045423.206592:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:12365:x1870706863329408:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1275us (1839us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045423.206600:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 185 00010000:00010000:3.0:1784045423.573221:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784045423.767166:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045423.767174:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045423.767214:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784045423.767223:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784045423.767354:0:13774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841f3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1870706873881600:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784045423.767476:0:13774:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c81254780 going to sleep for 11 seconds 00000100:00100000:3.0:1784045423.772984:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.773024:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863329536 00000100:00100000:3.0:1784045423.773033:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863329536 00000100:00100000:3.0:1784045423.773084:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 186 00000100:00100000:3.0:1784045423.773094:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+66:12377:x1870706863329536:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784045423.773124:0:6498:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784045423.773264:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+66:12377:x1870706863329536:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 171us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045423.773272:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 186 00000100:00100000:0.0:1784045423.774071:0:13774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841f3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1870706873881600:192.168.203.44@tcp:107:hsm_cdtr.0 00000001:00080000:1.0:1784045423.776326:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00010000:00010000:0.0:1784045423.776368:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776382:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d000 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784045423.776390:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:0.0:1784045423.776390:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776401:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cd400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045423.776406:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784045423.776410:0:6475:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939c83dfbe40 refcount 2 committed 0 result 0 batchid 5 00010000:00010000:0.0:1784045423.776414:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d000 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784045423.776416:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939b833fff00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff939c8831eb40 00000020:00080000:1.0:1784045423.776424:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939b833ff800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939b8230b200 00010000:00010000:0.0:1784045423.776440:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff939b81924c00) 00010000:00010000:0.0:1784045423.776479:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045423.776485:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d000 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776555:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d000 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784045423.776573:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:0.0:1784045423.776580:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d007 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776589:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d007 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776595:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d007 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776601:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045423.776605:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d007 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776612:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d007 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784045423.776620:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1784045423.776623:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:0.0:1784045423.776628:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045423.776631:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d007 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045423.776637:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873881728:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1784045423.776640:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d007 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776661:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454d046 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045423.776704:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784045423.776758:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454d046 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776765:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454d046 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776770:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2170200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045423.776773:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454d046 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776779:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454d046 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776788:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c900) 00010000:00010000:0.0:1784045423.776791:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045423.776793:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454d046 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776800:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2170200/0x5475624df454d046 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776820:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454d149 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776827:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454d149 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776833:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454d149 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776838:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045423.776848:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454d149 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776855:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454d149 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776866:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:0.0:1784045423.776868:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045423.776871:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454d149 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776877:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171800/0x5475624df454d149 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776889:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d16c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776894:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d16c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776899:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d16c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776903:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045423.776906:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d16c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776911:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d16c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776919:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:0.0:1784045423.776921:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045423.776930:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d16c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776937:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171200/0x5475624df454d16c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776952:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d1b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776959:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d1b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776965:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d1b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776972:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045423.776975:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d1b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776982:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d1b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.776990:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:0.0:1784045423.776993:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045423.776995:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d1b2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.777000:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d1b2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045423.777025:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873881728 00000100:00100000:0.0:1784045423.777031:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873881728 00000100:00100000:0.0:1784045423.777092:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784045423.777111:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873881728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784045423.777138:0:8648:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1784045423.777168:0:8648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a565f6c, atime: 0x6a565f6c, ctime: 0x6a565f6c, blocks: 0x8 00010000:00010000:0.0:1784045423.777175:0:8648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b557f8a8/0x5475624df454d25a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.777190:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1784045423.777195:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045423.777202:0:8648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b557f8a8/0x5475624df454d25a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.777219:0:8648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b557f8a8/0x5475624df454d25a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.777229:0:8648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b557f8a8/0x5475624df454d25a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.777251:0:8648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b557f8a8/0x5475624df454d25a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.777277:0:8648:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784045423.777410:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3624:x1870706873881728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 302us (705us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784045423.777418:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:1.0:1784045423.777513:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939b841c5f80/2, rc 0, transno 4294967308 00000100:00100000:1.0:1784045423.777520:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873881728:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1784045423.777577:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784045423.777591:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045423.777598:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b557f8a8/0x5475624df454d25a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.777618:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3e00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:0.0:1784045423.777622:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b557f8a8/0x5475624df454d25a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.777631:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b557f8a8/0x5475624df454d25a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.777644:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b557f8a8/0x5475624df454d25a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.777652:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b557f8a8/0x5475624df454d25a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.777669:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045423.777672:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045423.777685:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045423.782340:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.782809:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863329664 00000100:00100000:3.0:1784045423.782818:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863329664 00000100:00100000:3.0:1784045423.782882:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 187 00000100:00100000:3.0:1784045423.782894:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:12377:x1870706863329664:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1784045423.782966:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d261 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.782990:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d261 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.783004:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d261 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784408:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d268 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784428:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d268 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784440:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d268 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784491:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d26f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784499:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d26f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784505:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d26f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045423.784553:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784045423.784558:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784045423.784572:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d26f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784584:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d261 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784603:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d261 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784610:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d261 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784616:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045423.784621:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d261 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784629:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d261 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784642:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c813ee300) 00010000:00010000:3.0:1784045423.784645:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045423.784650:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d261 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784656:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d261 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784669:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d268 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784675:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d268 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784681:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d268 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784686:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045423.784697:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d268 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784704:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d268 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784712:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff939c93a85000) 00010000:00010000:3.0:1784045423.784715:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045423.784718:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d268 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784723:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d268 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784751:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d26f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784758:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d26f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784764:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d26f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784769:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045423.784772:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d26f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784779:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d26f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784788:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:3.0:1784045423.784790:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045423.784799:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d26f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.784805:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d26f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045423.784903:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:12377:x1870706863329664:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 Request processed in 2007us (2567us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045423.784913:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 187 00000100:00100000:3.0:1784045423.788435:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045423.788541:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863329920 00000100:00100000:1.0:1784045423.788551:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863329920 00000100:00100000:1.0:1784045423.788605:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 188 00000100:00100000:1.0:1784045423.788614:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+17:12377:x1870706863329920:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045423.788632:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045423.788652:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454d276 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f14e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.788752:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454d27d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.788768:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454d27d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.788802:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454d27d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045423.788816:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1784045423.788911:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454d27d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.788918:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454d27d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.788925:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454d27d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.788931:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cdc00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045423.788935:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454d27d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.788941:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454d27d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.788953:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:1.0:1784045423.788956:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045423.788961:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454d27d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.788967:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cdc00/0x5475624df454d27d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.789008:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454d276 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f14e expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.789031:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c813ee300) 00010000:00010000:1.0:1784045423.789034:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045423.789038:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454d276 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f14e expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.789046:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cc000, rc 0) 00000100:00100000:1.0:1784045423.789112:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:12377:x1870706863329920:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 499us (1036us total) trans 4294967460 rc 301/301 00000100:00100000:1.0:1784045423.789119:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 188 00000100:00100000:1.0:1784045423.792417:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045423.792801:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863330048 00000100:00100000:2.0:1784045423.792810:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863330048 00000100:00100000:2.0:1784045423.792907:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 189 00000100:00100000:2.0:1784045423.792916:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:12377:x1870706863330048:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784045423.792951:0:6497:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784045423.793068:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:12377:x1870706863330048:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 152us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045423.793075:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 189 00000100:00100000:3.0:1784045423.806252:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045423.806422:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863330304 00000100:00100000:1.0:1784045423.806432:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863330304 00000100:00100000:1.0:1784045423.806522:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 190 00000100:00100000:1.0:1784045423.806533:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:12377:x1870706863330304:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045423.806556:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045423.806559:0:6498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784045423.806584:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d230 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f140 expref: 18 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.806602:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:1.0:1784045423.806607:0:6498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045423.806620:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454d28b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f155 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784045423.807008:0:6498:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1784045423.807153:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d292 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.807165:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.807174:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.807219:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454d28b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f155 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.807245:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d292 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f155 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.807252:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b81924100) 00010000:00010000:1.0:1784045423.807255:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045423.807257:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cd000, rc 0) 00000100:00100000:1.0:1784045423.807319:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:12377:x1870706863330304:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 788us (1085us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1784045423.807325:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 190 00000100:00100000:3.0:1784045423.808573:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.808605:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.808626:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.808647:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.808665:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.808682:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.808714:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863330816 00000100:00100000:3.0:1784045423.808722:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863330816 00000100:00100000:3.0:1784045423.808772:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863330688 00000100:00100000:3.0:1784045423.808775:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863330688 00000100:00100000:3.0:1784045423.808809:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 166 00000100:00100000:3.0:1784045423.808819:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863330816:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045423.808880:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863330816:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 63us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045423.808888:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 166 00000100:00100000:3.0:1784045423.808914:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 167 00000100:00100000:3.0:1784045423.808920:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863330688:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045423.808963:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2395:x1870706863330688:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 44us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045423.808969:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 167 00000100:00100000:3.0:1784045423.809124:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863330432 00000100:00100000:3.0:1784045423.809128:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863330432 00000100:00100000:3.0:1784045423.809163:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 391 00000100:00100000:3.0:1784045423.809171:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863330432:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045423.809195:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97796c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863330432:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 27us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045423.809200:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 391 00000100:00080000:3.0:1784045423.809223:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045423.809226:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045423.809255:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863330560 00000100:00100000:3.0:1784045423.809259:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863330560 00000100:00100000:3.0:1784045423.809295:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863331072 00000100:00100000:3.0:1784045423.809298:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863331072 00000100:00100000:3.0:1784045423.809311:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863330944 00000100:00100000:3.0:1784045423.809314:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863330944 00000100:00100000:3.0:1784045423.809329:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 334 00000100:00100000:3.0:1784045423.809334:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863330560:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045423.809360:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863330560:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045423.809366:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 334 00000100:00100000:3.0:1784045423.809378:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 335 00000100:00100000:3.0:1784045423.809384:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863331072:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045423.809406:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863331072:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 23us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045423.809419:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 335 00000100:00100000:3.0:1784045423.809432:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 336 00000100:00100000:3.0:1784045423.809438:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863330944:12345-192.168.203.44@tcp:400:kworker.0 00000100:00080000:2.0:1784045423.809479:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045423.809484:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784045423.809503:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863330944:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 64us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045423.809509:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 336 00000100:00100000:0.0:1784045423.811231:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.811304:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863331328 00000100:00100000:3.0:1784045423.811313:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863331328 00000100:00100000:3.0:1784045423.811368:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 191 00000100:00100000:3.0:1784045423.811377:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:12377:x1870706863331328:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045423.811427:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045423.811476:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d292 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f155 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811494:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b81924100) 00010000:00010000:3.0:1784045423.811513:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045423.811533:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811547:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811556:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811568:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d2a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xb052fd89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811584:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d2a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb052fd89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811590:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d2a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb052fd89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811626:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811631:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2a0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811636:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811641:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045423.811644:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811650:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811657:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045423.811660:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045423.811663:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811668:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811676:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d2a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xb052fd89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811697:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d2a7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb052fd89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811703:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d2a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb052fd89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811715:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045423.811718:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d2a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb052fd89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811724:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d2a7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xb052fd89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811731:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xb052fd89 (ffff939c93a85000) 00010000:00010000:3.0:1784045423.811734:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045423.811737:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d2a7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xb052fd89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.811743:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d2a7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xb052fd89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045423.811833:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:12377:x1870706863331328:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 456us (607us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784045423.811840:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 191 00000100:00100000:0.0:1784045423.816898:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045423.817689:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863331456 00000100:00100000:2.0:1784045423.817698:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863331456 00000100:00100000:2.0:1784045423.817954:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 192 00000100:00100000:2.0:1784045423.817964:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:12377:x1870706863331456:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045423.817983:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045423.818008:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d2ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f15c expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045423.818042:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045423.818056:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045423.818067:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045423.818162:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d2ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f15c expref: 20 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045423.818179:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f15c expref: 19 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045423.818186:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b8310ce00) 00010000:00010000:2.0:1784045423.818189:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784045423.818192:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986c00, rc 0) 00000100:00100000:2.0:1784045423.818260:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:12377:x1870706863331456:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 298us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045423.818266:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 192 00000100:00100000:1.0:1784045423.822104:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045423.823602:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863331712 00000100:00100000:0.0:1784045423.823614:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863331712 00000100:00100000:0.0:1784045423.823680:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 193 00000100:00100000:0.0:1784045423.823689:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:12377:x1870706863331712:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784045423.823766:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d2bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.823879:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d2bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.823893:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d2bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045423.824054:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1784045423.824064:0:6498:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379932618876ns, next at 380932616832ns, rc = 0 00000004:00010000:0.0:1784045423.824109:0:6498:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026c82954 reply state 00000000294b1007 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d2bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.824121:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d2bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.824128:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b8310ce00) 00010000:00010000:0.0:1784045423.824131:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1784045423.824134:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045423.824264:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:12377:x1870706863331712:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 576us (2165us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1784045423.824271:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 193 00000100:00100000:1.0:1784045423.828773:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045423.828885:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863331840 00000100:00100000:0.0:1784045423.828894:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863331840 00000100:00100000:0.0:1784045423.828959:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 194 00000100:00100000:0.0:1784045423.828970:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:12377:x1870706863331840:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045423.828993:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045423.829014:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d2c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f163 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.829084:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d2c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f163 expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.829101:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d2c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f163 expref: 22 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.829119:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b8310ce00) 00010000:00010000:0.0:1784045423.829122:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784045423.829127:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b3c00, rc 0) 00000100:00100000:0.0:1784045423.829177:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:12377:x1870706863331840:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 209us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045423.829185:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 194 00000100:00100000:0.0:1784045423.842025:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.842116:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863331968 00000100:00100000:3.0:1784045423.842125:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863331968 00000100:00100000:3.0:1784045423.842203:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:3.0:1784045423.842214:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+6:2397:x1870706863331968:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1784045423.842430:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2397:x1870706863331968:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 218us (414us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1784045423.842470:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:0.0:1784045423.849376:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045423.852896:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863332224 00000100:00100000:2.0:1784045423.852911:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863332224 00000100:00100000:3.0:1784045423.853228:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 49 00000100:00100000:3.0:1784045423.853248:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:12377:x1870706863332224:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784045423.853765:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:12377:x1870706863332224:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 516us (4399us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1784045423.853774:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 49 00000100:00100000:1.0:1784045423.858215:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045423.858302:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863332480 00000100:00100000:2.0:1784045423.858312:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863332480 00000100:00100000:2.0:1784045423.858370:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 195 00000100:00100000:2.0:1784045423.858380:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:12377:x1870706863332480:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784045423.858713:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:12377:x1870706863332480:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 333us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045423.858721:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 195 00000100:00100000:0.0:1784045423.876711:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.878199:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863332608 00000100:00100000:3.0:1784045423.878215:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863332608 00000100:00100000:1.0:1784045423.878418:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 196 00000100:00100000:1.0:1784045423.878431:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:12377:x1870706863332608:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045423.878475:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045423.878497:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d2ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f16a expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.878596:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d2d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.878610:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.878622:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045423.878665:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784045423.878685:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.878709:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d2ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f16a expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.878727:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d2d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f16a expref: 24 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045423.878735:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b8310ce00) 00010000:00010000:1.0:1784045423.878737:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784045423.878740:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cd400, rc 0) 00000100:00100000:1.0:1784045423.878799:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:12377:x1870706863332608:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 372us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045423.878806:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 196 00000100:00100000:0.0:1784045423.885794:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.885882:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863332736 00000100:00100000:3.0:1784045423.885891:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863332736 00000100:00100000:3.0:1784045423.885947:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:3.0:1784045423.885957:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863332736:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045423.885975:0:9935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045423.885994:0:9935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f369aef1/0x5475624df454d2d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f171 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784045423.886019:0:9935:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565f6f, blocks: 0x0 00010000:00010000:3.0:1784045423.886037:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1784045423.886041:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045423.886050:0:9935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f369aef1/0x5475624df454d2d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f171 expref: 8 pid: 9935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.886067:0:9935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f369aef1/0x5475624df454d2d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f171 expref: 8 pid: 9935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.886101:0:9935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030000, rc 0) 00000100:00100000:3.0:1784045423.886169:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2394:x1870706863332736:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 213us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045423.886177:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:2.0:1784045423.896846:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.896973:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863332992 00000100:00100000:3.0:1784045423.896984:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863332992 00000100:00100000:2.0:1784045423.897260:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 197 00000100:00100000:2.0:1784045423.897272:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc10fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:12377:x1870706863332992:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784045423.898127:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc10fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:12377:x1870706863332992:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 853us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045423.898137:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 197 00000100:00100000:3.0:1784045423.910317:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045423.910768:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863333120 00000100:00100000:0.0:1784045423.910778:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863333120 00000100:00100000:0.0:1784045423.910895:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:0.0:1784045423.910905:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c921f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:12377:x1870706863333120:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045423.910923:0:8648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045423.910941:0:8648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007233a325/0x5475624df454d2df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f178 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.910973:0:8648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f369aef1/0x5475624df454d2d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f171 expref: 9 pid: 9935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.910990:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1784045423.910994:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045423.911000:0:8648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007233a325/0x5475624df454d2df lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f178 expref: 9 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.911035:0:8648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f369aef1/0x5475624df454d2d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f171 expref: 9 pid: 9935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.911048:0:8648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f369aef1/0x5475624df454d2d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f171 expref: 9 pid: 9935 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045423.911063:0:8648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b835b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8648:1870706873881856:192.168.203.44@tcp:104: 00000100:00100000:0.0:1784045423.911174:0:8648:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c81254780 going to sleep for 11 seconds 00000100:00100000:0.0:1784045423.913768:0:8648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b835b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8648:1870706873881856:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045423.913803:0:8648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007233a325/0x5475624df454d2df lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f178 expref: 9 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.913825:0:8648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b2a00, rc 0) 00000100:00100000:0.0:1784045423.913885:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c921f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:12377:x1870706863333120:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 2981us (3577us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045423.913893:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:0.0:1784045423.929131:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045423.929179:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863333248 00000100:00100000:0.0:1784045423.929188:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863333248 00010000:00010000:0.0:1784045423.929246:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f369aef1/0x5475624df454d2d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f171 expref: 9 pid: 9935 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045423.930118:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 87 00000100:00100000:0.0:1784045423.930133:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2395:x1870706863333248:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045423.930150:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045423.930173:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f369aef1/0x5475624df454d2d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f171 expref: 9 pid: 9935 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.930189:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f369aef1/0x5475624df454d2d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f171 expref: 9 pid: 9935 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.930215:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f369aef1/0x5475624df454d2d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f171 expref: 9 pid: 9935 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.930244:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045423.930249:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045423.930257:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007233a325/0x5475624df454d2df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f178 expref: 8 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.930267:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007233a325/0x5475624df454d2df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f178 expref: 8 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045423.930304:0:6483:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007233a325/0x5475624df454d2df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f178 expref: 8 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045423.930336:0:6483:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b835b5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6483:1870706873881984:192.168.203.44@tcp:105: 00000100:00100000:0.0:1784045423.930432:0:6483:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c81254780 going to sleep for 11 seconds 00000100:00100000:0.0:1784045423.937413:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045423.937497:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863333376 00000100:00100000:0.0:1784045423.937505:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863333376 00002000:00100000:0.0:1784045423.937556:0:8418:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff939b835b6300 x1870706863333376/t0(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:64/0 lens 504/0 e 0 to 0 dl 1784045434 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784045423.937567:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b835b6300 with x1870706863333376 ext(0->8) 00002000:00010000:0.0:1784045423.937572:0:8418:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939b835b6300 00000100:00100000:0.0:1784045423.937600:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:0.0:1784045423.937610:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2395:x1870706863333376:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1784045423.938944:0:6483:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b835b5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6483:1870706873881984:192.168.203.44@tcp:105: 00010000:00010000:3.0:1784045423.938967:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045423.939022:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:2395:x1870706863333248:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 8894us (9900us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045423.939032:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 87 00000100:00100000:3.0:1784045423.943707:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:2395:x1870706863333376:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 Request processed in 6087us (6292us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1784045423.943721:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 4 00002000:00100000:3.0:1784045423.943733:0:8418:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff939b835b6300 x1870706863333376/t4294967315(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:64/0 lens 504/448 e 0 to 0 dl 1784045434 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784045423.943743:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b835b6300 with x1870706863333376 ext(0->8) 00002000:00010000:3.0:1784045423.943748:0:8418:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939b835b6300 00000100:00100000:0.0:1784045423.952141:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.952647:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863333504 00000100:00100000:3.0:1784045423.952657:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863333504 00000100:00100000:3.0:1784045423.952713:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 198 00000100:00100000:3.0:1784045423.952724:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b835b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:12377:x1870706863333504:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1784045423.958207:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:0.0:1784045423.958228:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1784045423.958260:0:6475:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1784045423.958284:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1784045423.958294:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1784045423.958427:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b835b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:12377:x1870706863333504:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 Request processed in 5699us (6288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045423.958437:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 198 00000100:00100000:2.0:1784045423.958739:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1784045423.958748:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d2bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045423.958755:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873882112:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1784045423.958758:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d2bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.958765:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d2bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.958771:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045423.958775:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d2bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.958782:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d2bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045423.958798:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784045423.958799:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b8310ce00) 00010000:00010000:3.0:1784045423.958802:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784045423.958807:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d2bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.958813:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d2bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045423.958834:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873882112 00000100:00100000:2.0:1784045423.958840:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873882112 00000100:00100000:2.0:1784045423.958886:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784045423.958905:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873882112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1784045423.959021:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1784045423.959025:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1784045423 00002000:00010000:2.0:1784045423.959027:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784045423.959030:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1784045423 -> 1784045423 00002000:00010000:2.0:1784045423.959033:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1784045423.959066:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1870706873882112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (268us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1784045423.959079:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1784045423.959115:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939b823bed80/2, rc 0, transno 4294967316 00000100:00100000:2.0:1784045423.959121:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873882112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784045423.967945:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.968013:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863333632 00000100:00100000:3.0:1784045423.968024:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863333632 00000100:00100000:3.0:1784045423.968085:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:3.0:1784045423.968096:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:2394:x1870706863333632:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1784045423.973346:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1784045423.973360:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1784045423.981857:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863333632:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 Request processed in 13752us (13911us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045423.981882:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:2.0:1784045423.994890:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045423.998854:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863333888 00000100:00100000:3.0:1784045423.998868:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863333888 00000100:00100000:3.0:1784045423.998938:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 199 00000100:00100000:3.0:1784045423.998947:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:12377:x1870706863333888:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045423.998998:0:10615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045423.999025:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d2d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f16a expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.999042:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b8310ce00) 00010000:00010000:3.0:1784045423.999047:0:10615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045423.999075:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.999089:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.999098:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045423.999208:0:10615:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000028b997a3 reply state 000000000845c248 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.999221:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045423.999227:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b8310ce00) 00010000:00010000:3.0:1784045423.999230:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784045423.999252:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045423.999349:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:12377:x1870706863333888:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 403us (4470us total) trans 4294967464 rc 0/0 00000100:00100000:3.0:1784045423.999356:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 199 00000100:00100000:0.0:1784045424.009014:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.013196:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863334016 00000100:00100000:2.0:1784045424.013211:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863334016 00000100:00100000:2.0:1784045424.013391:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:2.0:1784045424.013402:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863334016:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784045424.013578:0:8648:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1784045424.013581:0:8648:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1784045423 -> 1784045422 00002000:00010000:2.0:1784045424.013584:0:8648:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1784045420 00002000:00010000:2.0:1784045424.013586:0:8648:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1784045423 -> 1784045422 00002000:00010000:2.0:1784045424.013588:0:8648:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1784045424.013667:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2395:x1870706863334016:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 266us (4661us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1784045424.013675:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:3.0:1784045424.017721:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045424.018098:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863334272 00000100:00100000:1.0:1784045424.018108:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863334272 00000100:00100000:1.0:1784045424.018182:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 200 00000100:00100000:1.0:1784045424.018193:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:12377:x1870706863334272:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 00000100:00080000:3.0:1784045424.018248:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784045424.018271:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.018288:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f15c expref: 20 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.018298:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.018333:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f15c expref: 20 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.018347:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f15c expref: 20 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045424.018362:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873882240:192.168.203.44@tcp:104: 00000100:00100000:1.0:1784045424.018481:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045424.025649:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873882240:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045424.025683:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045424.027845:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045424.027928:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863334400 00000100:00100000:1.0:1784045424.027937:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863334400 00010000:00010000:1.0:1784045424.027979:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f15c expref: 21 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045424.028044:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 88 00000100:00100000:1.0:1784045424.028054:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe49c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:2394:x1870706863334400:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045424.028071:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045424.028079:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f15c expref: 21 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.028094:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f15c expref: 21 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.028116:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f15c expref: 21 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.028131:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b8310ce00) 00010000:00010000:1.0:1784045424.028136:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.028146:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.028154:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.028188:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045424.028257:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe49c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:2394:x1870706863334400:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 204us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045424.028266:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 88 00010000:00010000:2.0:1784045424.028376:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.028386:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.028434:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.028839:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.028861:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.028867:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045424.028871:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.028883:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.028902:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b8310ce00) 00010000:00010000:2.0:1784045424.028906:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784045424.028910:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.028916:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d2ed lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045424.028983:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:12377:x1870706863334272:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 Request processed in 10790us (11268us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784045424.028992:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 200 00000100:00100000:3.0:1784045424.039481:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045424.040139:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863334528 00000100:00100000:0.0:1784045424.040150:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863334528 00000100:00100000:0.0:1784045424.040256:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 65 00000100:00100000:0.0:1784045424.040266:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2395:x1870706863334528:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784045424.040317:0:9935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.040340:0:9935:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007233a325/0x5475624df454d2df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f178 expref: 8 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.040349:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045424.040354:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784045424.040358:0:9935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.040396:0:9935:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007233a325/0x5475624df454d2df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f178 expref: 8 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.040409:0:9935:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007233a325/0x5475624df454d2df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f178 expref: 8 pid: 8648 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045424.040424:0:9935:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83688a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9935:1870706873882368:192.168.203.44@tcp:104: 00000100:00100000:0.0:1784045424.040548:0:9935:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c832c7180 going to sleep for 11 seconds 00000100:00100000:0.0:1784045424.049022:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045424.049059:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863334656 00000100:00100000:0.0:1784045424.049070:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863334656 00010000:00010000:0.0:1784045424.049111:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007233a325/0x5475624df454d2df lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f178 expref: 9 pid: 8648 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045424.049153:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 89 00000100:00100000:0.0:1784045424.049163:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2394:x1870706863334656:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045424.049188:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045424.049213:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007233a325/0x5475624df454d2df lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f178 expref: 9 pid: 8648 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.049228:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007233a325/0x5475624df454d2df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f178 expref: 9 pid: 8648 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.049265:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784045424.049269:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784045424.049274:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.049284:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.049304:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045424.049352:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2394:x1870706863334656:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 191us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.049360:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 89 00010000:00010000:1.0:1784045424.049539:0:9935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007233a325/0x5475624df454d2df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f178 expref: 8 pid: 8648 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045424.049561:0:9935:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83688a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:9935:1870706873882368:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045424.049580:0:9935:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.049589:0:9935:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.049596:0:9935:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.049616:0:9935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.049624:0:9935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.049631:0:9935:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.049639:0:9935:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2200 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045424.049643:0:9935:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.049653:0:9935:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.049673:0:9935:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.049681:0:9935:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1934575/0x5475624df454d2f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045424.049750:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863334528:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 Request processed in 9485us (10306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045424.049759:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 65 00000100:00100000:0.0:1784045424.057384:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.057553:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863334912 00000100:00100000:2.0:1784045424.057563:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863334912 00000100:00100000:2.0:1784045424.057624:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 201 00000100:00100000:2.0:1784045424.057635:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:12377:x1870706863334912:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784045424.057812:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.057830:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d142 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f101 expref: 19 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.057850:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.057882:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f101 expref: 19 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.057894:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d142 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f101 expref: 19 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045424.057908:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873882496:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045424.058018:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939ca15ce3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045424.076317:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045424.076552:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863335040 00000100:00100000:1.0:1784045424.076561:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863335040 00010000:00010000:1.0:1784045424.076600:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d142 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f101 expref: 20 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045424.076641:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 90 00000100:00100000:1.0:1784045424.076649:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:2395:x1870706863335040:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045424.076664:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045424.076670:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d142 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f101 expref: 20 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.076682:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d142 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f101 expref: 20 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.076704:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:1.0:1784045424.076710:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.076727:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.076734:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.076753:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045424.077008:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171000/0x5475624df454d142 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f101 expref: 20 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.077024:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873882496:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045424.077042:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.077052:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.077058:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.077243:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.077262:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d2c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f163 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.077271:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.077297:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d2c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f163 expref: 20 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.077317:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d2c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f163 expref: 20 pid: 6496 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.077330:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873882624:192.168.203.44@tcp:104: 00000100:00100000:1.0:1784045424.077402:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf551180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:2395:x1870706863335040:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 752us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045424.077411:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 90 00000100:00100000:3.0:1784045424.078067:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700000 going to sleep for 11 seconds 00000100:00100000:2.0:1784045424.082905:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873882624:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045424.082937:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.083372:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.083518:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863335168 00000100:00100000:2.0:1784045424.083526:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863335168 00010000:00010000:2.0:1784045424.083575:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d2c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f163 expref: 20 pid: 6496 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045424.083612:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 91 00000100:00100000:2.0:1784045424.083621:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:2395:x1870706863335168:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045424.083636:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045424.083642:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d2c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f163 expref: 20 pid: 6496 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.083685:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d2c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f163 expref: 20 pid: 6496 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.083709:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d2c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f163 expref: 20 pid: 6496 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.083725:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b8310ce00) 00010000:00010000:2.0:1784045424.083731:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.083741:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.083749:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.083780:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045424.083841:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:2395:x1870706863335168:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 220us (470us total) trans 0 rc 0/0 00010000:00010000:1.0:1784045424.083847:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045424.083848:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 91 00010000:00010000:1.0:1784045424.083855:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784045424.083969:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1784045424.084082:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:1.0:1784045424.084121:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:1.0:1784045424.084196:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10615:1870706873882752:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784045424.084265:0:10615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.084295:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045424.084406:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873882752 00000100:00100000:2.0:1784045424.084411:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873882752 00000100:00100000:2.0:1784045424.084475:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784045424.084483:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10615:x1870706873882752:12345-0@lo:1000:mdt00_003.0 00000100:00080000:1.0:1784045424.084638:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045424.084803:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10615:x1870706873882752:12345-0@lo:1000:mdt00_003.0 Request processed in 319us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.084811:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1784045424.085981:0:10615:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:1.0:1784045424.085989:0:10615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939b823bed80, transno 4294967316 00000100:00100000:1.0:1784045424.086012:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10615:1870706873882752:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1784045424.086152:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:1.0:1784045424.086220:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10615:1870706873882880:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784045424.086296:0:10615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.086324:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c9600 going to sleep for 11 seconds 00000100:00100000:2.0:1784045424.086363:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873882880 00000100:00100000:2.0:1784045424.086369:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873882880 00000100:00100000:2.0:1784045424.086417:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784045424.086426:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10615:x1870706873882880:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784045424.086731:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10615:x1870706873882880:12345-0@lo:1000:mdt00_003.0 Request processed in 306us (435us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1784045424.086739:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1784045424.088095:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10615:1870706873882880:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1784045424.088145:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088156:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088163:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088168:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045424.088172:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088179:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088194:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b8310ce00) 00010000:00010000:1.0:1784045424.088197:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045424.088202:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088207:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d302 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088230:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d237 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088247:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d237 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088261:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d237 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088266:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045424.088269:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d237 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088275:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d237 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088284:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:1.0:1784045424.088287:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045424.088290:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d237 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088296:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d237 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088321:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088335:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d253 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f147 expref: 22 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088343:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088376:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d253 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f147 expref: 22 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.088400:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d253 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f147 expref: 22 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045424.088412:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873883008:192.168.203.44@tcp:104: 00000100:00100000:1.0:1784045424.088515:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c937ea900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045424.094836:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045424.096407:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873883008:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045424.096438:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045424.096487:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863335296 00000100:00100000:1.0:1784045424.096492:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863335296 00010000:00010000:1.0:1784045424.096605:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d253 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f147 expref: 23 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045424.096655:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 92 00000100:00100000:1.0:1784045424.096666:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:2394:x1870706863335296:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045424.096682:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045424.096689:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d253 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f147 expref: 23 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096702:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d253 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f147 expref: 23 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096724:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d253 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f147 expref: 23 pid: 10615 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096754:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:1.0:1784045424.096758:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096768:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096776:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096798:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045424.096851:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:2394:x1870706863335296:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 186us (2022us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045424.096858:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 92 00010000:00010000:1.0:1784045424.096886:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096894:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096905:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096910:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096916:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096922:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cda00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045424.096934:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096941:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096950:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:1.0:1784045424.096952:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045424.096956:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096961:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d309 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096972:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096978:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096983:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096988:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045424.096990:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.096996:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.097002:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b81924700) 00010000:00010000:1.0:1784045424.097004:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784045424.097014:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.097019:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d2fb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045424.097157:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:12377:x1870706863334912:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 39524us (39783us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1784045424.097165:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 201 00000020:00080000:1.0:1784045424.097168:0:10615:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1784045424.098751:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045424.098758:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045424.099215:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1784045424.099227:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1784045424.108968:0:14686:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784045424.108977:0:14686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784045424.109000:0:14686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1784045424.109006:0:14686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784045424.109761:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045424.109799:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863335552 00000100:00100000:3.0:1784045424.109808:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863335552 00000100:00100000:3.0:1784045424.109856:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:3.0:1784045424.109865:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c98558850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:12377:x1870706863335552:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784045424.110114:0:6499:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784045424.110145:0:6499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1784045424.110178:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d310 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.110193:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.110204:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d310 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.110212:0:6499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d310 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.110218:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d310 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.110253:0:6499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d310 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.110273:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784045424.110356:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c98558850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:12377:x1870706863335552:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 491us (598us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1784045424.110363:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 50 00000020:00080000:3.0:1784045424.110368:0:6499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784045424.110415:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045424.110421:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d310 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.110427:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045424.110431:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d310 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.110439:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d310 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.110473:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b8310ce00) 00010000:00010000:3.0:1784045424.110476:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784045424.110480:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d310 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.110486:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d310 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.110497:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045424.110499:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045424.110501:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045424.246662:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045424.246814:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863335808 00000100:00100000:0.0:1784045424.246824:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863335808 00000100:00100000:0.0:1784045424.246905:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 202 00000100:00100000:0.0:1784045424.246916:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:12387:x1870706863335808:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1784045424.246948:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045424.246972:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d317 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f17f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.247087:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3800/0x5475624df454d31e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.247103:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3800/0x5475624df454d31e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.247117:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3800/0x5475624df454d31e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045424.247128:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1784045424.247254:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d317 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f17f expref: 26 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.247272:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3800/0x5475624df454d31e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f17f expref: 25 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.247280:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:0.0:1784045424.247283:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784045424.247287:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b3800, rc 0) 00000100:00100000:0.0:1784045424.247359:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:12387:x1870706863335808:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 445us (706us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1784045424.247366:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 202 00000100:00100000:0.0:1784045424.266200:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045424.274407:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863335936 00000100:00100000:3.0:1784045424.274421:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863335936 00000100:00100000:3.0:1784045424.275790:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 203 00000100:00100000:3.0:1784045424.275807:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:12387:x1870706863335936:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:3.0:1784045424.275893:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d32c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.275911:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d32c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.275924:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d32c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.275939:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d333 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.275945:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.275952:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276022:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d33a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276030:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d33a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276036:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d33a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045424.276084:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d33a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276110:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d32c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276116:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d32c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276123:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d32c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276129:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045424.276133:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d32c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276140:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d32c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276152:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045424.276155:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045424.276160:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d32c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276168:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d32c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276180:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276185:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d333 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276190:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d333 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276201:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045424.276204:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d333 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276210:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d333 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276218:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939c93a85300) 00010000:00010000:3.0:1784045424.276221:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045424.276223:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d333 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276229:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d333 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276263:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d33a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276270:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d33a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276276:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d33a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276281:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045424.276284:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d33a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276289:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d33a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276307:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939c93a85800) 00010000:00010000:3.0:1784045424.276309:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045424.276312:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d33a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.276318:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d33a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.276403:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:12387:x1870706863335936:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 601us (10211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.276411:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 203 00000100:00100000:2.0:1784045424.278599:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873883136:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.278669:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045424.278716:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873883648:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.278743:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045424.278763:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873884160:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.278786:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045424.279874:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873884672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045424.279916:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045424.279952:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784045424.279960:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873883520:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.279983:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.280100:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873884160 00000100:00100000:1.0:1784045424.280109:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873884160 00000100:00080000:1.0:1784045424.280376:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045424.280420:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1784045424.280430:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8364b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873884160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045424.280501:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8364b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873884160:12345-0@lo:400:kworker.0 Request processed in 73us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045424.280508:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1784045424.285093:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873883136 00000100:00100000:3.0:1784045424.285108:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873883136 00000100:00100000:3.0:1784045424.285166:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1784045424.285176:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873883136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045424.285275:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873883136:12345-0@lo:400:kworker.0 Request processed in 100us (6605us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.285284:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1784045424.285326:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873883392:0@lo:400:kworker.0 00000100:00100000:3.0:1784045424.285359:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045424.285384:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873883904:0@lo:400:kworker.0 00000100:00100000:3.0:1784045424.285411:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873883264:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.288143:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873883648 00000100:00100000:2.0:1784045424.288156:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873883648 00000100:00100000:2.0:1784045424.288200:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873884672 00000100:00100000:2.0:1784045424.288204:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873884672 00000100:00100000:2.0:1784045424.288217:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873883392 00000100:00100000:2.0:1784045424.288220:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873883392 00000100:00100000:2.0:1784045424.288249:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784045424.288260:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873883648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045424.288290:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873883520 00000100:00100000:3.0:1784045424.288297:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873883520 00000100:00100000:3.0:1784045424.288332:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1784045424.288339:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873883520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045424.288425:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873883520:12345-0@lo:400:kworker.0 Request processed in 87us (8440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.288433:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1784045424.288475:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045424.288505:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873884416:0@lo:400:kworker.0 00000100:00100000:3.0:1784045424.288539:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045424.288591:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873884416 00000100:00100000:3.0:1784045424.288595:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873884416 00000100:00100000:3.0:1784045424.288629:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784045424.288634:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873884416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045424.288669:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873884416:12345-0@lo:400:kworker.0 Request processed in 34us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.288676:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1784045424.288690:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045424.288700:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873883904 00000100:00100000:3.0:1784045424.288703:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873883904 00000100:00100000:3.0:1784045424.288722:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1784045424.288728:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873883904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045424.288755:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873883904:12345-0@lo:400:kworker.0 Request processed in 27us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.288760:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00080000:3.0:1784045424.288774:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784045424.288798:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cc13b5f80 x1870706873883904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045424.288812:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873883904:0@lo:400:kworker.0 00000100:00100000:3.0:1784045424.288823:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873884416:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.289146:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873883648:12345-0@lo:400:kworker.0 Request processed in 887us (10400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.289161:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784045424.289177:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784045424.289183:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3626:x1870706873884672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784045424.289209:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1784045424.289253:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3626:x1870706873884672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (9336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.289260:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784045424.289272:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1784045424.289279:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873883392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.290639:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873883392:12345-0@lo:400:kworker.0 Request processed in 1355us (5273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.290649:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1784045424.290698:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045424.290731:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873883776:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.290762:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045424.290779:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873884288:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.290798:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045424.290850:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873883520:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.290858:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873884032:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.290883:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045424.290909:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873884032 00000100:00100000:2.0:1784045424.290915:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873884032 00000100:00100000:2.0:1784045424.290959:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784045424.290966:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873884032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.291011:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873884032:12345-0@lo:400:kworker.0 Request processed in 45us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.291018:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:2.0:1784045424.291036:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045424.291053:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873884032:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.291060:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873884544:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.291081:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045424.291104:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873884544 00000100:00100000:2.0:1784045424.291107:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873884544 00000100:00100000:2.0:1784045424.291129:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784045424.291135:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3626:x1870706873884544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.291164:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3626:x1870706873884544:12345-0@lo:400:kworker.0 Request processed in 29us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.291170:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784045424.291196:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873884544:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.291215:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873884672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045424.291226:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873883136:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.291247:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873883648:0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.291257:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873884160:0@lo:400:kworker.0 00000100:00100000:3.0:1784045424.293483:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873883264 00000100:00100000:3.0:1784045424.293498:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873883264 00000100:00100000:2.0:1784045424.293539:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873883392:0@lo:400:kworker.0 00000100:00100000:3.0:1784045424.293562:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873883776 00000100:00100000:3.0:1784045424.293566:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873883776 00000100:00100000:2.0:1784045424.293581:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873884288 00000100:00100000:2.0:1784045424.293587:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873884288 00000100:00100000:3.0:1784045424.293610:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1784045424.294117:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1784045424.294135:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873883776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.294222:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873883776:12345-0@lo:400:kworker.0 Request processed in 87us (3457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.294240:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1784045424.294262:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1784045424.294270:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873884288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045424.294304:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873884288:12345-0@lo:400:kworker.0 Request processed in 36us (3504us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.294368:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1784045424.294540:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873883776:0@lo:400:kworker.0 00010000:00080000:2.0:1784045424.294556:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c88337b80 x1870706873884288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045424.294567:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873884288:0@lo:400:kworker.0 00000100:00080000:2.0:1784045424.294603:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045424.294608:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045424.296322:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873883264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045424.296657:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873883264:12345-0@lo:400:kworker.0 Request processed in 3036us (5956us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.296667:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1784045424.296740:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873883264:0@lo:400:kworker.0 00000100:00100000:1.0:1784045424.345662:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.346810:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863336192 00000100:00100000:2.0:1784045424.346821:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863336192 00000100:00100000:2.0:1784045424.346940:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 204 00000100:00100000:2.0:1784045424.346951:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:12390:x1870706863336192:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045424.346978:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045424.347001:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d341 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f186 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347071:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d348 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347115:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d348 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347126:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d348 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347147:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d34f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347154:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d34f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347161:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d34f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347285:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d356 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347294:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347301:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d356 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045424.347311:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1784045424.347392:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d348 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347400:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d348 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347407:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d348 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347419:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045424.347424:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d348 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347432:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d348 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347486:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:2.0:1784045424.347490:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045424.347494:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d348 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347500:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d348 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347513:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d34f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347518:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d34f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347524:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d34f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347529:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045424.347532:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d34f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347537:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d34f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347554:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c200) 00010000:00010000:2.0:1784045424.347557:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045424.347560:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d34f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347575:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d34f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347616:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d341 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f186 expref: 28 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347630:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d356 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f186 expref: 27 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.347637:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:2.0:1784045424.347639:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045424.347642:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987200, rc 0) 00000100:00100000:2.0:1784045424.347704:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:12390:x1870706863336192:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 755us (2050us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1784045424.347711:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 204 00000100:00100000:0.0:1784045424.358815:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.358919:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863336320 00000100:00100000:2.0:1784045424.358929:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863336320 00000100:00100000:2.0:1784045424.358986:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 205 00000100:00100000:2.0:1784045424.358996:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:12390:x1870706863336320:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:2.0:1784045424.359060:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d364 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.359076:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d364 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.359114:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d364 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.359151:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d364 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.359158:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d364 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.359164:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d364 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.359170:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045424.359174:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d364 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.359180:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d364 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.359192:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:2.0:1784045424.359196:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045424.359200:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d364 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.359206:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d364 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045424.359288:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:12390:x1870706863336320:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 293us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.359295:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 205 00000100:00100000:3.0:1784045424.363183:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045424.363539:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863336576 00000100:00100000:1.0:1784045424.363550:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863336576 00000100:00100000:1.0:1784045424.363717:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:1.0:1784045424.363726:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:12390:x1870706863336576:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:1.0:1784045424.364099:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+28:12390:x1870706863336576:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 372us (925us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1784045424.364122:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:1.0:1784045424.421407:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045424.421659:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863336832 00000100:00100000:0.0:1784045424.421669:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863336832 00000100:00100000:0.0:1784045424.421733:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 206 00000100:00100000:0.0:1784045424.421744:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+28:11922:x1870706863336832:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1784045424.421769:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045424.421790:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d36b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f18d expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.421897:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.421913:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d356 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f186 expref: 29 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.421923:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.421956:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d356 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f186 expref: 29 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.421968:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d356 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f186 expref: 29 pid: 6497 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045424.421981:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf553800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873884800:192.168.203.44@tcp:104: 00000100:00100000:0.0:1784045424.422101:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c832c7180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045424.428766:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf553800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873884800:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045424.428815:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045424.429181:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045424.429276:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863336960 00000100:00100000:3.0:1784045424.429285:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863336960 00010000:00010000:3.0:1784045424.429392:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d356 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f186 expref: 30 pid: 6497 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.429430:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 93 00000100:00100000:3.0:1784045424.429441:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:2396:x1870706863336960:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045424.429481:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045424.429489:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d356 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f186 expref: 30 pid: 6497 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.429511:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d356 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f186 expref: 30 pid: 6497 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.429535:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d356 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f186 expref: 30 pid: 6497 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.429552:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:3.0:1784045424.429562:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.429571:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.429579:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.429610:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045424.429667:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf551c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:2396:x1870706863336960:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 227us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.429675:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 93 00010000:00010000:2.0:1784045424.429741:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.429750:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045424.429769:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1784045424.429956:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d36b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f18d expref: 30 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.430063:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f18d expref: 29 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.430072:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:2.0:1784045424.430075:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784045424.430077:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b3a00, rc 0) 00000100:00100000:2.0:1784045424.430113:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:11922:x1870706863336832:12345-192.168.203.44@tcp:101:bash.0 Request processed in 8371us (8715us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1784045424.430120:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 206 00000100:00100000:3.0:1784045424.432867:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.433135:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863337088 00000100:00100000:2.0:1784045424.433144:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863337088 00000100:00100000:2.0:1784045424.433195:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 207 00000100:00100000:2.0:1784045424.433203:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:11922:x1870706863337088:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1784045424.433225:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045424.433252:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d380 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f194 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.433777:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d387 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.433792:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.433805:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.434396:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d380 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f194 expref: 31 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.434418:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f194 expref: 30 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.434428:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:2.0:1784045424.434432:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784045424.434435:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986a00, rc 0) 00000100:00100000:2.0:1784045424.434557:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:11922:x1870706863337088:12345-192.168.203.44@tcp:101:bash.0 Request processed in 1354us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.434566:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 207 00000100:00100000:3.0:1784045424.443427:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.443662:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863337344 00000100:00100000:2.0:1784045424.443671:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863337344 00000100:00100000:2.0:1784045424.443729:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 208 00000100:00100000:2.0:1784045424.443738:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:11922:x1870706863337344:12345-192.168.203.44@tcp:36:bash.0 00010000:00010000:2.0:1784045424.443964:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d38e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.444000:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d38e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.444013:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d38e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045424.444053:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:2.0:1784045424.444073:0:6497:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004b71399 reply state 00000000c0adec75 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d38e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.444085:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d38e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.444093:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:2.0:1784045424.444096:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784045424.444099:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1784045424.444129:0:6497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:2.0:1784045424.444216:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+34:11922:x1870706863337344:12345-192.168.203.44@tcp:36:bash.0 Request processed in 478us (797us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1784045424.444223:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 208 00000020:00080000:2.0:1784045424.444228:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1784045424.446528:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045424.446614:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863337472 00000100:00100000:3.0:1784045424.446623:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863337472 00000100:00100000:3.0:1784045424.446680:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 209 00000100:00100000:3.0:1784045424.446690:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+34:11922:x1870706863337472:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1784045424.446722:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045424.446740:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d395 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f19b expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.446791:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d395 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f19b expref: 35 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.446805:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d395 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f19b expref: 35 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.446845:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:3.0:1784045424.446848:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784045424.446852:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030000, rc 0) 00000100:00100000:3.0:1784045424.446920:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+35:11922:x1870706863337472:12345-192.168.203.44@tcp:101:bash.0 Request processed in 230us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.446927:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 209 00000100:00100000:3.0:1784045424.449573:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045424.449670:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863337600 00000100:00100000:0.0:1784045424.449679:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863337600 00000100:00100000:0.0:1784045424.449734:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:0.0:1784045424.449743:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:11922:x1870706863337600:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1784045424.449758:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045424.449778:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009677f31/0x5475624df454d39c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1a2 expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784045424.449802:0:8412:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a565f6e, atime: 0x6a565f6c, ctime: 0x6a565f6e, blocks: 0x8 00010000:00010000:0.0:1784045424.449822:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1784045424.449827:0:8412:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045424.449835:0:8412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009677f31/0x5475624df454d39c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1a2 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.449849:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009677f31/0x5475624df454d39c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1a2 expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.449860:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b2400, rc 0) 00000100:00100000:0.0:1784045424.449923:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:11922:x1870706863337600:12345-192.168.203.44@tcp:101:bash.0 Request processed in 180us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.449931:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:0.0:1784045424.452367:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045424.452475:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863337728 00000100:00100000:3.0:1784045424.452483:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863337728 00002000:00010000:3.0:1784045424.452526:0:8419:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1784045424.452531:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939cbf553800 with x1870706863337728 ext(0->18446744073709551615) 00002000:00010000:3.0:1784045424.452542:0:8419:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939cbf553800. 00000100:00100000:3.0:1784045424.452564:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:3.0:1784045424.452573:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2395:x1870706863337728:12345-192.168.203.44@tcp:10:bash.0 00002000:00010000:3.0:1784045424.452957:0:8419:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1784045424.452961:0:8419:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1784045422 -> 1784045423 00002000:00010000:3.0:1784045424.452963:0:8419:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1784045420 -> 1784045420 00002000:00010000:3.0:1784045424.452966:0:8419:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1784045422 -> 1784045423 00002000:00010000:3.0:1784045424.452968:0:8419:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1784045424.453140:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2395:x1870706863337728:12345-192.168.203.44@tcp:10:bash.0 Request processed in 566us (781us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1784045424.453149:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5 00002000:00010000:3.0:1784045424.453152:0:8419:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1784045424.453155:0:8419:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939cbf553800 with x1870706863337728 ext(0->18446744073709551615) 00002000:00010000:3.0:1784045424.453169:0:8419:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939cbf553800. 00000100:00100000:1.0:1784045424.529053:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.529692:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863337856 00000100:00100000:2.0:1784045424.529702:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863337856 00000100:00100000:3.0:1784045424.529847:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 210 00000100:00100000:3.0:1784045424.529858:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+35:12404:x1870706863337856:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:3.0:1784045424.529933:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3a3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.529950:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.529962:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.529976:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.529984:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.529992:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530060:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d3b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530070:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530076:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045424.530133:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530165:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530171:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3a3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530178:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530184:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045424.530188:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530195:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530207:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045424.530210:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045424.530213:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530219:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530241:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530247:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530252:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530264:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045424.530267:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530272:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530280:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939c93a85800) 00010000:00010000:3.0:1784045424.530282:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045424.530285:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530290:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530313:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530320:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d3b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530324:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530329:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045424.530332:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530337:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d3b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530354:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:3.0:1784045424.530356:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045424.530359:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d3b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.530365:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d3b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.530534:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+35:12404:x1870706863337856:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 677us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.530542:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 210 00000100:00100000:1.0:1784045424.572664:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045424.572772:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863338112 00000100:00100000:3.0:1784045424.572783:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863338112 00000100:00100000:3.0:1784045424.572891:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 211 00000100:00100000:3.0:1784045424.572901:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+35:12407:x1870706863338112:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045424.572921:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045424.572940:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d3b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1a9 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573017:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573032:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573042:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573056:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573088:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573097:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573209:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d3cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573218:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d3cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573225:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d3cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045424.573244:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784045424.573316:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573322:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573329:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573334:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045424.573337:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573344:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573364:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045424.573367:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045424.573370:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573376:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d3bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573389:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573395:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573400:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573405:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045424.573408:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573413:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573419:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939c93a85800) 00010000:00010000:3.0:1784045424.573421:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045424.573424:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573429:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d3c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573535:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d3b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1a9 expref: 38 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573549:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d3cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1a9 expref: 37 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.573556:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:3.0:1784045424.573558:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784045424.573560:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030e00, rc 0) 00000100:00100000:3.0:1784045424.573826:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+37:12407:x1870706863338112:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 925us (1170us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1784045424.573834:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 211 00000100:00100000:1.0:1784045424.577437:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045424.577737:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863338240 00000100:00100000:3.0:1784045424.577747:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863338240 00000100:00100000:3.0:1784045424.577800:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 212 00000100:00100000:3.0:1784045424.577810:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+37:12407:x1870706863338240:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:3.0:1784045424.577872:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.577953:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f18d expref: 37 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.577965:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.578219:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f18d expref: 37 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.578264:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f18d expref: 37 pid: 6496 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.578279:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873884928:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045424.578400:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784045424.580873:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.581010:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863338496 00000100:00100000:2.0:1784045424.581019:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863338496 00000100:00100000:2.0:1784045424.581110:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:2.0:1784045424.581120:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:11391:x1870706863338496:12345-192.168.203.44@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784045424.581395:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+39:11391:x1870706863338496:12345-192.168.203.44@tcp:35:ldlm_bl.0 Request processed in 276us (530us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1784045424.581420:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:3.0:1784045424.581510:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873884928:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045424.581532:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.583240:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045424.583352:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863338624 00000100:00100000:0.0:1784045424.583361:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863338624 00010000:00010000:0.0:1784045424.583399:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f18d expref: 39 pid: 6496 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045424.583488:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 94 00000100:00100000:0.0:1784045424.583504:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+39:2395:x1870706863338624:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045424.583519:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045424.583526:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f18d expref: 39 pid: 6496 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583538:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f18d expref: 39 pid: 6496 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583561:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d372 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f18d expref: 39 pid: 6496 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583577:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:0.0:1784045424.583582:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583591:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583598:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583624:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045424.583674:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:2395:x1870706863338624:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 171us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.583682:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 94 00010000:00010000:0.0:1784045424.583708:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583721:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583758:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583765:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583772:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583778:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106ea00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045424.583782:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583788:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583797:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:0.0:1784045424.583799:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784045424.583802:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.583808:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d3db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045424.583844:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+37:12407:x1870706863338240:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 6036us (6417us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.583852:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 212 00000100:00100000:0.0:1784045424.586644:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045424.586731:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863338880 00000100:00100000:1.0:1784045424.586740:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863338880 00000100:00100000:1.0:1784045424.587019:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:1.0:1784045424.587029:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+37:12407:x1870706863338880:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:1.0:1784045424.587246:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf551500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:12407:x1870706863338880:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 218us (609us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1784045424.587253:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 53 00010000:00010000:3.0:1784045424.595702:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045424.669928:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.670044:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863339136 00000100:00100000:2.0:1784045424.670053:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863339136 00000100:00100000:2.0:1784045424.670114:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 213 00000100:00100000:2.0:1784045424.670124:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+38:12418:x1870706863339136:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:2.0:1784045424.670148:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045424.670169:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d3e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1b0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.670249:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d3e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.670263:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d3e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.670274:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d3e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.670288:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d3f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.670295:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.670302:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.670412:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d3f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.670439:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671047:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045424.671059:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1784045424.671138:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d3e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671146:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d3e9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671152:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d3e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671157:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045424.671162:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d3e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671168:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d3e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671180:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:2.0:1784045424.671182:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045424.671187:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d3e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671193:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d3e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671206:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671218:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d3f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671224:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671239:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045424.671242:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671248:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d3f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671257:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c200) 00010000:00010000:2.0:1784045424.671260:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045424.671263:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d3f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671269:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d3f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671314:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d3e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1b0 expref: 41 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671327:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1b0 expref: 40 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.671334:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:2.0:1784045424.671336:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045424.671345:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986800, rc 0) 00000100:00100000:2.0:1784045424.671401:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+40:12418:x1870706863339136:12345-192.168.203.44@tcp:101:cat.0 Request processed in 1277us (1481us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1784045424.671409:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 213 00000100:00100000:3.0:1784045424.676588:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.677250:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863339392 00000100:00100000:2.0:1784045424.677260:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863339392 00000100:00100000:2.0:1784045424.677386:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:2.0:1784045424.677397:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+40:12418:x1870706863339392:12345-192.168.203.44@tcp:35:cat.0 00000100:00100000:2.0:1784045424.677716:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+41:12418:x1870706863339392:12345-192.168.203.44@tcp:35:cat.0 Request processed in 320us (1136us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1784045424.677723:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:0.0:1784045424.699176:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.699434:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863339648 00000100:00100000:2.0:1784045424.699484:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863339648 00000100:00100000:2.0:1784045424.699553:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 214 00000100:00100000:2.0:1784045424.699571:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+41:12419:x1870706863339648:12345-192.168.203.44@tcp:36:rm.0 00010000:00010000:2.0:1784045424.699627:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1784045424.699651:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d395 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f19b expref: 41 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.699674:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d3f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1b0 expref: 40 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.699687:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d3cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1a9 expref: 39 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.699698:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d387 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f194 expref: 38 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.699728:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:2.0:1784045424.699732:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045424.699754:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d405 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.699767:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d405 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.699778:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d405 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.699797:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d40c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.699804:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d40c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.699810:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d40c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.699881:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d413 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.699891:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.699898:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784045424.700116:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00010000:00010000:2.0:1784045424.700167:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d41a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700183:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d41a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700191:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d41a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700198:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d41a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700204:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d41a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700210:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d41a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700253:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045424.700274:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d413 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700281:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d413 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700286:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d413 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700292:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045424.700296:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d413 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700303:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d413 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700322:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:2.0:1784045424.700324:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784045424.700327:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d413 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700333:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d413 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700348:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d405 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700354:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d405 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700359:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d405 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700363:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045424.700365:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d405 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700370:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d405 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700376:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:2.0:1784045424.700378:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045424.700381:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d405 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700386:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d405 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045424.700405:0:6496:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000620f7d9e reply state 000000007bff382d transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d40c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700415:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d40c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.700420:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c200) 00010000:00010000:2.0:1784045424.700422:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784045424.700424:0:6496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784045424.700530:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+39:12419:x1870706863339648:12345-192.168.203.44@tcp:36:rm.0 Request processed in 960us (1361us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1784045424.700537:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 214 00010000:00010000:1.0:1784045424.701481:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045424.701490:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d41a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.701498:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986e00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045424.701502:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d41a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.701508:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d41a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.701520:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:1.0:1784045424.701523:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784045424.701536:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d41a lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.701542:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d41a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.701565:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045424.701567:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045424.701568:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045424.737744:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045424.738291:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863339904 00000100:00100000:3.0:1784045424.738302:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863339904 00000100:00100000:3.0:1784045424.738366:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 215 00000100:00100000:3.0:1784045424.738376:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+39:12425:x1870706863339904:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1784045424.738401:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045424.738422:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d421 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1b7 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.738552:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d428 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.738579:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d428 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.738590:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d428 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.738618:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d42f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.738625:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d42f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.738631:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d42f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784045424.738965:0:10615:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1784045424.739097:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d436 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.739106:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d436 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.739124:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d436 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.739158:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d428 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.739166:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d428 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.739172:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d428 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.739178:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106ea00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045424.739182:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d428 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.739200:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d428 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.739214:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045424.739217:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045424.739222:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d428 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.739237:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d428 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045424.739252:0:10615:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fa77dd9d reply state 00000000eccc11d1 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d42f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.739263:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d42f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.739268:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c200) 00010000:00010000:3.0:1784045424.739270:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784045424.739273:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784045424.739300:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d421 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1b7 expref: 42 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.739315:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d436 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1b7 expref: 41 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.739323:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939c93a85800) 00010000:00010000:3.0:1784045424.739325:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045424.739327:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030000, rc 0) 00000100:00100000:3.0:1784045424.739411:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+42:12425:x1870706863339904:12345-192.168.203.44@tcp:101:bash.0 Request processed in 1037us (1675us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1784045424.739419:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 215 00000100:00100000:3.0:1784045424.743066:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.743246:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863340032 00000100:00100000:2.0:1784045424.743256:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863340032 00000100:00100000:1.0:1784045424.743362:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:1.0:1784045424.743374:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863340032:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:1.0:1784045424.743390:0:9935:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045424.743415:0:9935:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454d444 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1be expref: -99 pid: 9935 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784045424.743439:0:9935:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784045424.743729:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1784045424.743734:0:9935:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045424.743744:0:9935:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454d444 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1be expref: 8 pid: 9935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.743761:0:9935:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454d444 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1be expref: 8 pid: 9935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.743773:0:9935:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cc000, rc 0) 00000100:00100000:1.0:1784045424.743871:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2395:x1870706863340032:12345-192.168.203.44@tcp:101:bash.0 Request processed in 499us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045424.743877:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:0.0:1784045424.749293:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.750457:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863340160 00000100:00100000:2.0:1784045424.750468:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863340160 00000100:00100000:2.0:1784045424.750562:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:2.0:1784045424.750572:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:12425:x1870706863340160:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1784045424.750589:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045424.750606:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1c5 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.750636:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454d444 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1be expref: 9 pid: 9935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.750645:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045424.750649:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045424.750665:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 9 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.750701:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454d444 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1be expref: 9 pid: 9935 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.750715:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454d444 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1be expref: 9 pid: 9935 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045424.750730:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1870706873885056:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045424.751044:0:8411:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c83dfbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045424.755526:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045424.755633:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863340288 00000100:00100000:1.0:1784045424.755643:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863340288 00010000:00010000:1.0:1784045424.755682:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454d444 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1be expref: 10 pid: 9935 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045424.755725:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 95 00000100:00100000:1.0:1784045424.755734:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:2394:x1870706863340288:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045424.755752:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045424.755773:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454d444 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1be expref: 10 pid: 9935 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.755797:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454d444 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1be expref: 10 pid: 9935 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.755823:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045424.755828:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045424.755836:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 10 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.755845:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 10 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.755881:0:6482:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 10 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045424.755901:0:6482:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6482:1870706873885184:192.168.203.44@tcp:105: 00000100:00100000:1.0:1784045424.756001:0:6482:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c81254180 going to sleep for 11 seconds 00010000:00010000:2.0:1784045424.756514:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afc6f34f/0x5475624df454d444 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1be expref: 10 pid: 9935 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045424.756533:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8411:1870706873885056:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045424.756615:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 9 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.756626:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986200, rc 0) 00000100:00100000:2.0:1784045424.756711:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:12425:x1870706863340160:12345-192.168.203.44@tcp:101:bash.0 Request processed in 6140us (7426us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.756720:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:0.0:1784045424.760952:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045424.761093:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863340544 00000100:00100000:3.0:1784045424.761153:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863340544 00000100:00100000:3.0:1784045424.761258:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:3.0:1784045424.761268:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+42:12425:x1870706863340544:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:3.0:1784045424.761744:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+43:12425:x1870706863340544:12345-192.168.203.44@tcp:35:bash.0 Request processed in 476us (798us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1784045424.761751:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:1.0:1784045424.762088:0:6482:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841f1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6482:1870706873885184:192.168.203.44@tcp:105: 00010000:00010000:1.0:1784045424.762113:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045424.762203:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2394:x1870706863340288:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 6469us (6686us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045424.762212:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 95 00000100:00100000:3.0:1784045424.787902:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045424.787930:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873885312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045424.788020:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045424.788294:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873885312 00000100:00100000:1.0:1784045424.788302:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873885312 00000100:00100000:1.0:1784045424.788358:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784045424.788369:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873885312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784045424.788397:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045424.788472:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873885312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045424.788479:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784045424.788539:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873885312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045424.789766:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045424.789782:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873885440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045424.789831:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045424.790025:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873885440 00000100:00100000:3.0:1784045424.790031:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873885440 00000100:00100000:3.0:1784045424.790075:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784045424.790083:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1870706873885440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784045424.791723:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045424.791821:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1870706873885440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1736us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.791831:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784045424.792682:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873885440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045424.889739:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.891367:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863340672 00000100:00100000:2.0:1784045424.891379:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863340672 00000100:00100000:2.0:1784045424.891497:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 216 00000100:00100000:2.0:1784045424.891508:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+43:12441:x1870706863340672:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045424.891541:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045424.891561:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d452 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1cc expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.891631:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d459 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.891646:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d459 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.891657:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d459 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045424.891707:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784045424.891711:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045424.891729:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d459 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.891752:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1cc expref: 45 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.891768:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d459 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1cc expref: 44 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.891777:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:2.0:1784045424.891780:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045424.891798:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986a00, rc 0) 00000100:00100000:2.0:1784045424.891861:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+44:12441:x1870706863340672:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 355us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.891868:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 216 00000100:00100000:0.0:1784045424.896141:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045424.896325:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863340928 00000100:00100000:3.0:1784045424.896334:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863340928 00000100:00100000:3.0:1784045424.896393:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 217 00000100:00100000:3.0:1784045424.896402:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+44:12441:x1870706863340928:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045424.896438:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045424.896596:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d460 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1d3 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.896755:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d467 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.896771:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d467 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.896784:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d467 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045424.896796:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784045424.897195:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d460 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1d3 expref: 47 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.897216:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d467 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1d3 expref: 46 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.897225:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939c93a85800) 00010000:00010000:3.0:1784045424.897239:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045424.897243:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80031000, rc 0) 00000100:00100000:3.0:1784045424.897356:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+46:12441:x1870706863340928:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 953us (1220us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1784045424.897364:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 217 00000100:00100000:0.0:1784045424.901363:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045424.901472:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863341184 00000100:00100000:3.0:1784045424.901482:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863341184 00000100:00100000:3.0:1784045424.901602:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 218 00000100:00100000:3.0:1784045424.901628:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+46:12441:x1870706863341184:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045424.901650:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045424.901672:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d475 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1da expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.901893:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d47c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.901944:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d47c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.901955:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d47c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045424.901967:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00100000:0.0:1784045424.902320:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045424.902407:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863341312 00000100:00100000:1.0:1784045424.902412:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863341312 00000100:00100000:1.0:1784045424.902518:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:1.0:1784045424.902527:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+48:2397:x1870706863341312:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045424.902539:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045424.902555:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d467 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1d3 expref: 48 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.902571:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939c93a85800) 00010000:00010000:1.0:1784045424.902584:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045424.902633:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+47:2397:x1870706863341312:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 107us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045424.902641:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00010000:00010000:3.0:1784045424.902795:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d475 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1da expref: 48 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.902810:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d47c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1da expref: 47 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.902818:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939c93a85800) 00010000:00010000:3.0:1784045424.902821:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784045424.902823:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106e600, rc 0) 00000100:00100000:3.0:1784045424.902858:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+47:12441:x1870706863341184:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1232us (1502us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1784045424.902865:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 218 00000100:00100000:0.0:1784045424.912560:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.912722:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863341440 00000100:00100000:2.0:1784045424.912733:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863341440 00000100:00100000:2.0:1784045424.912826:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:2.0:1784045424.912846:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2394:x1870706863341440:12345-192.168.203.44@tcp:1:lfs.0 00010000:00010000:2.0:1784045424.912891:0:8648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.912910:0:8648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.912918:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1784045424.912923:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045424.912927:0:8648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.912960:0:8648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.912973:0:8648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 8 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045424.912988:0:8648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8648:1870706873885568:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045424.913077:0:8648:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c83dfbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045424.916335:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045424.916413:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863341568 00000100:00100000:3.0:1784045424.916422:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863341568 00000100:00100000:2.0:1784045424.916590:0:8648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8648:1870706873885568:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045424.916614:0:8648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1784045424.916718:0:8418:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff939b841ff100 x1870706863341568/t0(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:65/0 lens 504/0 e 0 to 0 dl 1784045435 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784045424.916728:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b841ff100 with x1870706863341568 ext(0->8) 00010000:00010000:3.0:1784045424.916735:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 9 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.916749:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 9 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784045424.916757:0:8418:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939b841ff100 00000100:00100000:3.0:1784045424.916821:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:3.0:1784045424.916831:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2395:x1870706863341568:12345-192.168.203.44@tcp:4:lfs.0 00000100:00100000:3.0:1784045424.917833:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:2395:x1870706863341568:12345-192.168.203.44@tcp:4:lfs.0 Request processed in 999us (1503us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1784045424.917850:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3 00002000:00100000:3.0:1784045424.917859:0:8418:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff939b841ff100 x1870706863341568/t4294967309(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:65/0 lens 504/448 e 0 to 0 dl 1784045435 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784045424.917869:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b841ff100 with x1870706863341568 ext(0->8) 00010000:00010000:3.0:1784045424.917876:0:8418:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 11 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.917899:0:8418:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 11 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784045424.917907:0:8418:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff939b841ff100 00000100:00100000:0.0:1784045424.920397:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045424.920473:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863341696 00000100:00100000:3.0:1784045424.920483:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863341696 00010000:00010000:3.0:1784045424.920531:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 11 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.920568:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 96 00000100:00100000:3.0:1784045424.920579:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:2397:x1870706863341696:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045424.920596:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1784045424.920613:0:6483:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784045424.920616:0:6483:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1784045424 00002000:00010000:3.0:1784045424.920618:0:6483:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1784045424 00002000:00010000:3.0:1784045424.920620:0:6483:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1784045424 00002000:00010000:3.0:1784045424.920623:0:6483:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1784045424.920629:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 11 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.920642:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 11 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.920665:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454d44b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1c5 expref: 11 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.920682:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045424.920687:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045424.920692:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.920722:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045424.920755:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045424.920809:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:2397:x1870706863341696:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 232us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045424.920817:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 96 00010000:00010000:2.0:1784045424.921099:0:8648:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.921110:0:8648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.921130:0:8648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.921139:0:8648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.921147:0:8648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.921154:0:8648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987200 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045424.921159:0:8648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.921167:0:8648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.921193:0:8648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.921199:0:8648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454d48a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045424.921256:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2394:x1870706863341440:12345-192.168.203.44@tcp:1:lfs.0 Request processed in 8422us (8705us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.921264:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:0.0:1784045424.925115:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.925218:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863341952 00000100:00100000:2.0:1784045424.925238:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863341952 00000100:00100000:2.0:1784045424.925331:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:2.0:1784045424.925342:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9855b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+47:12441:x1870706863341952:12345-192.168.203.44@tcp:35:lfs.0 00000004:00010000:2.0:1784045424.925402:0:6500:0:(mdt_open.c:1993:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d47c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1da expref: 47 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045424.925653:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1784045424.925686:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1784045424.926093:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:2.0:1784045424.926131:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.926147:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d436 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1b7 expref: 51 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.926156:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.926196:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d436 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1b7 expref: 51 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.926211:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d436 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1b7 expref: 51 pid: 10615 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045424.926235:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6500:1870706873885696:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045424.926312:0:6500:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c83dfbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045424.929833:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.930178:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6500:1870706873885696:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045424.930205:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.930353:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863342080 00000100:00100000:3.0:1784045424.930360:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863342080 00010000:00010000:3.0:1784045424.930394:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d436 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1b7 expref: 52 pid: 10615 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045424.930436:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 97 00000100:00100000:3.0:1784045424.930951:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+52:2394:x1870706863342080:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045424.931043:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045424.931063:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d436 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1b7 expref: 52 pid: 10615 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.931077:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d436 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1b7 expref: 52 pid: 10615 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.931100:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d436 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1b7 expref: 52 pid: 10615 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.931116:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939c93a85800) 00010000:00010000:1.0:1784045424.931121:0:9500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.931129:0:9500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.931136:0:9500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045424.931166:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045424.931225:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+51:2394:x1870706863342080:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 779us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045424.931242:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 97 00010000:00010000:2.0:1784045424.931841:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.931850:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045424.932006:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:2.0:1784045424.932132:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1784045424.932212:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1870706873885824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784045424.932305:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045424.932340:0:6500:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc1337a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045424.933056:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873885824 00000100:00100000:0.0:1784045424.933064:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873885824 00000100:00100000:0.0:1784045424.933126:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784045424.933136:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6500:x1870706873885824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784045424.933263:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6500:x1870706873885824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 127us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045424.933273:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784045424.933403:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1870706873885824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784045424.933586:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:3.0:1784045424.933640:0:6500:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b830f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1870706873885952:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784045424.933684:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045424.933711:0:6500:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045424.933781:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873885952 00000100:00100000:2.0:1784045424.933785:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873885952 00000100:00100000:2.0:1784045424.933816:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1784045424.933824:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6500:x1870706873885952:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784045424.933989:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6500:x1870706873885952:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 165us (304us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784045424.933997:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1784045424.934204:0:6500:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b830f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6500:1870706873885952:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1784045424.934252:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1784045424.934286:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.934307:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.934313:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.934319:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045424.934323:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.934330:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.934344:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939c93a85800) 00010000:00010000:0.0:1784045424.934347:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1784045424.934351:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045424.934357:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d491 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784045424.934601:0:6500:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784045424.934708:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1784045424.934720:0:6500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381043275166ns, next at 382043272533ns, rc = 0 00000001:00080000:0.0:1784045424.934726:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:0.0:1784045424.934752:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939c93a85800) 00010000:00010000:0.0:1784045424.934755:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784045424.934762:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d47c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1da expref: 55 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045424.934916:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9855b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+54:12441:x1870706863341952:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 9576us (9811us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1784045424.934925:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 56 00000020:00080000:0.0:1784045424.934929:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1784045424.937400:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045424.937506:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863342208 00000100:00100000:2.0:1784045424.937514:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863342208 00000100:00100000:2.0:1784045424.937564:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 219 00000100:00100000:2.0:1784045424.937574:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+54:12441:x1870706863342208:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045424.937595:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045424.937619:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d498 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1e1 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.937684:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d498 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1e1 expref: 55 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.937698:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d498 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1e1 expref: 55 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045424.937718:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:2.0:1784045424.937722:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045424.937725:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987200, rc 0) 00000100:00100000:2.0:1784045424.937781:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+55:12441:x1870706863342208:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 208us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045424.937788:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 219 00000100:00100000:3.0:1784045424.940251:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045424.940350:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863342464 00000100:00100000:1.0:1784045424.940373:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863342464 00000100:00100000:1.0:1784045424.940508:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:1.0:1784045424.940519:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+55:12441:x1870706863342464:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:1.0:1784045424.940823:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+56:12441:x1870706863342464:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 306us (581us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1784045424.940832:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:1.0:1784045425.022556:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045425.022784:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863342592 00000100:00100000:2.0:1784045425.022794:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863342592 00000100:00100000:2.0:1784045425.022851:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 220 00000100:00100000:2.0:1784045425.022862:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+56:12451:x1870706863342592:12345-192.168.203.44@tcp:34:lfs.0 00010000:00010000:2.0:1784045425.022954:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d49f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.022971:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d49f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.022983:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d49f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.022997:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d4a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023005:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023012:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023085:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d4ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023094:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023101:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784045425.023148:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023160:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d49f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023175:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d49f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023181:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d49f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023187:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045425.023191:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d49f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023198:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d49f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023209:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:2.0:1784045425.023213:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045425.023217:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d49f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023223:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d49f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023251:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023257:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d4a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023263:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023268:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045425.023278:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023297:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d4a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023305:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c200) 00010000:00010000:2.0:1784045425.023307:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045425.023310:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d4a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023316:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d4a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023325:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d4ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023331:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d4ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023336:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d4ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023342:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045425.023344:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d4ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023350:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d4ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023357:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:2.0:1784045425.023359:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045425.023367:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d4ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.023373:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986800/0x5475624df454d4ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045425.023783:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+56:12451:x1870706863342592:12345-192.168.203.44@tcp:34:lfs.0 Request processed in 920us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045425.023792:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 220 00000100:00100000:2.0:1784045425.066113:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045425.066207:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863342848 00000100:00100000:0.0:1784045425.066216:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863342848 00000100:00100000:0.0:1784045425.066349:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 221 00000100:00100000:0.0:1784045425.066360:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+56:12454:x1870706863342848:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1784045425.066384:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045425.066407:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2e00/0x5475624df454d4b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1e8 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.066525:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454d4bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.066541:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454d4bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.066553:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454d4bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.066564:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d4c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.066572:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.066578:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.066696:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454d4c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.066705:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454d4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.066712:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454d4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045425.066721:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1784045425.067479:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454d4bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067489:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454d4bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067496:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454d4bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067502:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045425.067505:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454d4bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067512:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454d4bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067524:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:1.0:1784045425.067527:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045425.067531:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454d4bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067538:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3000/0x5475624df454d4bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067567:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067573:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d4c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067579:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067584:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045425.067587:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067593:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d4c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067601:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c200) 00010000:00010000:1.0:1784045425.067603:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045425.067606:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d4c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067612:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2a00/0x5475624df454d4c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067696:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2e00/0x5475624df454d4b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1e8 expref: 59 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067710:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454d4c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1e8 expref: 58 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.067729:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:1.0:1784045425.067732:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045425.067734:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b2200, rc 0) 00000100:00100000:1.0:1784045425.068082:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+58:12454:x1870706863342848:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1723us (1977us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1784045425.068091:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 221 00000100:00100000:0.0:1784045425.072316:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045425.072440:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863342976 00000100:00100000:3.0:1784045425.072485:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863342976 00000100:00100000:3.0:1784045425.072556:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 222 00000100:00100000:3.0:1784045425.072565:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+58:12454:x1870706863342976:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:3.0:1784045425.072656:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.072673:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.072687:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.072729:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.072736:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.072742:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.072748:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106ea00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045425.072752:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.072759:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.072771:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:3.0:1784045425.072774:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045425.072777:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.072784:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045425.072869:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+58:12454:x1870706863342976:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 304us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045425.072875:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 222 00000100:00100000:2.0:1784045425.075549:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045425.075709:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863343232 00000100:00100000:0.0:1784045425.075718:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863343232 00000100:00100000:0.0:1784045425.075782:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:0.0:1784045425.075792:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+58:12454:x1870706863343232:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:0.0:1784045425.076039:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+59:12454:x1870706863343232:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 248us (498us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1784045425.076048:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:0.0:1784045425.145432:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045425.145697:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863343488 00000100:00100000:3.0:1784045425.145708:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863343488 00000100:00100000:3.0:1784045425.145771:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 223 00000100:00100000:3.0:1784045425.145782:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c83900850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+59:12464:x1870706863343488:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1784045425.145809:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045425.145813:0:10615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784045425.145854:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d459 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1cc expref: 59 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.145875:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045425.145880:0:10615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045425.146207:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d4de lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1ef expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.146328:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.146343:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454d4c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1e8 expref: 59 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.146351:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.146390:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454d4c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1e8 expref: 59 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.146422:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454d4c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1e8 expref: 59 pid: 6498 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045425.146438:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b830f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873886080:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045425.146712:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045425.150967:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045425.151570:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863343616 00000100:00100000:1.0:1784045425.151579:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863343616 00010000:00010000:1.0:1784045425.151621:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454d4c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1e8 expref: 60 pid: 6498 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045425.151665:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 98 00000100:00100000:1.0:1784045425.151674:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:2395:x1870706863343616:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045425.151690:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045425.151697:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454d4c9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1e8 expref: 60 pid: 6498 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.151711:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454d4c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1e8 expref: 60 pid: 6498 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.151735:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:1.0:1784045425.151741:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.151751:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.151778:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.151799:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045425.151852:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:2395:x1870706863343616:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 178us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045425.151859:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 98 00010000:00010000:3.0:1784045425.153190:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2200/0x5475624df454d4c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1e8 expref: 59 pid: 6498 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045425.153213:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b830f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873886080:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045425.153244:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.153254:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.153261:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045425.153281:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784045425.153413:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d4de lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1ef expref: 60 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.153429:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1ef expref: 59 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.153437:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:3.0:1784045425.153656:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784045425.153660:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106ea00, rc 0) 00000100:00100000:3.0:1784045425.153721:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c83900850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+59:12464:x1870706863343488:12345-192.168.203.44@tcp:101:bash.0 Request processed in 7940us (8297us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1784045425.153729:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 223 00000100:00100000:0.0:1784045425.158593:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045425.158701:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863343744 00000100:00100000:3.0:1784045425.158710:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863343744 00000100:00100000:3.0:1784045425.158765:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 224 00000100:00100000:3.0:1784045425.158775:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+59:12464:x1870706863343744:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1784045425.158801:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045425.158823:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d4f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1f6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.158858:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d4fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.158871:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d4fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.158892:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d4fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.159289:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d4f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1f6 expref: 61 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.159308:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d4fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1f6 expref: 60 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.159316:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:3.0:1784045425.159325:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784045425.159329:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030c00, rc 0) 00000100:00100000:3.0:1784045425.159391:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:12464:x1870706863343744:12345-192.168.203.44@tcp:101:bash.0 Request processed in 616us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045425.159398:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 224 00000100:00100000:2.0:1784045425.162842:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045425.163136:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863344000 00000100:00100000:1.0:1784045425.163146:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863344000 00000100:00100000:1.0:1784045425.163236:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 225 00000100:00100000:1.0:1784045425.163245:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+60:12464:x1870706863344000:12345-192.168.203.44@tcp:36:bash.0 00010000:00010000:1.0:1784045425.163437:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d501 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.163474:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d501 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.163495:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d501 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784045425.163532:0:6498:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:1.0:1784045425.163552:0:6498:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f1b5a33a reply state 000000004d941f48 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d501 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.163564:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d501 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.163571:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:1.0:1784045425.163574:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784045425.163585:0:6498:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784045425.163668:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+63:12464:x1870706863344000:12345-192.168.203.44@tcp:36:bash.0 Request processed in 423us (835us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1784045425.163676:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 225 00000020:00080000:1.0:1784045425.163681:0:6498:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784045425.165417:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045425.165522:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863344128 00000100:00100000:2.0:1784045425.165531:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863344128 00000100:00100000:2.0:1784045425.165576:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 226 00000100:00100000:2.0:1784045425.165584:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+63:12464:x1870706863344128:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1784045425.165604:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045425.165623:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d508 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f1fd expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.165699:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.165712:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1ef expref: 64 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.165721:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.165749:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1ef expref: 64 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.165774:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1ef expref: 64 pid: 10615 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045425.165787:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88336300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873886208:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045425.165858:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fcd9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045425.168498:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045425.168579:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863344256 00000100:00100000:3.0:1784045425.168588:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863344256 00010000:00010000:3.0:1784045425.168624:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1ef expref: 65 pid: 10615 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045425.168663:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 99 00000100:00100000:3.0:1784045425.168672:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:2394:x1870706863344256:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045425.168684:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045425.168691:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1ef expref: 65 pid: 10615 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.168705:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1ef expref: 65 pid: 10615 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.168727:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:3.0:1784045425.168732:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.168742:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.168750:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.168787:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045425.168832:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:2394:x1870706863344256:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 161us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045425.168841:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 99 00010000:00010000:2.0:1784045425.169017:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d4e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1ef expref: 64 pid: 10615 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045425.169034:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88336300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873886208:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045425.169052:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.169061:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.169067:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045425.169119:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784045425.169123:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045425.169141:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.169169:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d508 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1fd expref: 64 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.169183:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1fd expref: 63 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045425.169198:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:2.0:1784045425.169201:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045425.169203:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986a00, rc 0) 00000100:00100000:2.0:1784045425.169241:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+63:12464:x1870706863344128:12345-192.168.203.44@tcp:101:bash.0 Request processed in 3658us (3830us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045425.169248:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 226 00000100:00100000:0.0:1784045425.175197:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045425.175283:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863344512 00000100:00100000:3.0:1784045425.175293:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863344512 00000100:00100000:3.0:1784045425.175343:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:3.0:1784045425.175352:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+63:12464:x1870706863344512:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:3.0:1784045425.175583:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+64:12464:x1870706863344512:12345-192.168.203.44@tcp:35:bash.0 Request processed in 231us (394us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1784045425.175591:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:0.0:1784045425.245047:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045425.245209:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863344640 00000100:00100000:3.0:1784045425.245219:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863344640 00000100:00100000:3.0:1784045425.245299:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 227 00000100:00100000:3.0:1784045425.245309:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+64:12470:x1870706863344640:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045425.245332:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045425.245351:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d516 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f204 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.245411:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d51d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.245424:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d51d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.245435:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d51d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045425.245537:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1784045425.245542:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784045425.245559:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d51d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.245581:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454d516 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f204 expref: 66 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.245598:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d51d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f204 expref: 65 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.245606:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045425.245609:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045425.245612:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80031000, rc 0) 00000100:00100000:3.0:1784045425.245673:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:12470:x1870706863344640:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 366us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045425.245680:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 227 00000100:00100000:0.0:1784045425.249104:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045425.249259:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863344768 00000100:00100000:3.0:1784045425.249269:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863344768 00000100:00100000:3.0:1784045425.249328:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 228 00000100:00100000:3.0:1784045425.249337:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:12470:x1870706863344768:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045425.249357:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045425.249377:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d524 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f20b expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249436:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d52b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249505:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d52b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249516:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d52b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249529:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d532 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249537:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d532 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249543:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d532 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249630:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633e00/0x5475624df454d539 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249645:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633e00/0x5475624df454d539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249653:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633e00/0x5475624df454d539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045425.249694:0:6496:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1784045425.249698:0:6496:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784045425.249717:0:6496:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633e00/0x5475624df454d539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249733:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633e00/0x5475624df454d539 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249751:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d52b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249758:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d52b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249764:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d52b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249769:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106ea00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045425.249773:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d52b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249780:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d52b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.249793:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:3.0:1784045425.249796:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045425.249800:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d52b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.250210:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106ea00/0x5475624df454d52b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.250237:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d532 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.250244:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d532 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.250250:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d532 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.250263:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106e600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045425.250266:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d532 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.250273:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d532 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.250282:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c200) 00010000:00010000:3.0:1784045425.250285:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045425.250288:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d532 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.250294:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e600/0x5475624df454d532 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.250336:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454d524 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f20b expref: 67 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.250352:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633e00/0x5475624df454d539 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f20b expref: 66 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.250360:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:3.0:1784045425.250363:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045425.250365:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93633e00, rc 0) 00000100:00100000:3.0:1784045425.250433:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+66:12470:x1870706863344768:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1096us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045425.250441:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 228 00000100:00100000:2.0:1784045425.254403:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045425.254530:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863345152 00000100:00100000:1.0:1784045425.254539:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863345152 00000100:00100000:1.0:1784045425.254601:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:1.0:1784045425.254611:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+66:2394:x1870706863345152:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045425.254626:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045425.254651:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633e00/0x5475624df454d539 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f20b expref: 66 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.254669:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:1.0:1784045425.254674:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045425.254724:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:2394:x1870706863345152:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 115us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045425.254732:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:0.0:1784045425.257129:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045425.257234:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863345024 00000100:00100000:3.0:1784045425.257248:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863345024 00000100:00100000:3.0:1784045425.257302:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 229 00000100:00100000:3.0:1784045425.257312:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:12470:x1870706863345024:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045425.257330:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045425.257350:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633000/0x5475624df454d540 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f212 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.257498:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.257514:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1fd expref: 66 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.257525:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.257560:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1fd expref: 66 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045425.257575:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1fd expref: 66 pid: 6496 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045425.257588:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b830f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873886336:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045425.257672:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045425.261259:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045425.261340:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863345280 00000100:00100000:0.0:1784045425.261350:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863345280 00010000:00010000:0.0:1784045425.261387:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1fd expref: 67 pid: 6496 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045425.261432:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 100 00000100:00100000:0.0:1784045425.261471:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:2394:x1870706863345280:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045425.261487:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045425.261505:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1fd expref: 67 pid: 6496 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.261517:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1fd expref: 67 pid: 6496 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.261538:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:0.0:1784045425.261543:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.261553:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.261560:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.261581:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045425.261633:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:2394:x1870706863345280:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 192us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045425.261642:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 100 00010000:00010000:1.0:1784045425.262522:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d50f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1fd expref: 66 pid: 6496 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045425.262541:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b830f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873886336:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045425.262569:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.262577:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.262583:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045425.262669:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784045425.262803:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633000/0x5475624df454d540 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f212 expref: 67 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.263122:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f212 expref: 66 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.263132:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:1.0:1784045425.263135:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784045425.263138:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93633800, rc 0) 00000100:00100000:1.0:1784045425.263245:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+66:12470:x1870706863345024:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 5934us (6124us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1784045425.263253:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 229 00000100:00100000:3.0:1784045425.271801:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045425.271918:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863345536 00000100:00100000:1.0:1784045425.271928:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863345536 00000100:00100000:1.0:1784045425.272000:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:1.0:1784045425.272010:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+66:12470:x1870706863345536:12345-192.168.203.44@tcp:103:lfs.0 00010000:00010000:1.0:1784045425.272026:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045425.272052:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d498 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1e1 expref: 66 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.272071:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:1.0:1784045425.272075:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045425.272128:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:12470:x1870706863345536:12345-192.168.203.44@tcp:103:lfs.0 Request processed in 119us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045425.272136:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:0.0:1784045425.293341:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045425.293510:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863345664 00000100:00100000:1.0:1784045425.293520:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863345664 00000100:00100000:1.0:1784045425.293594:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 230 00000100:00100000:1.0:1784045425.293603:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:12470:x1870706863345664:12345-192.168.203.44@tcp:58:lfs.0 00010000:00010000:1.0:1784045425.293703:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d555 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.293719:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d555 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045425.293731:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d555 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784045425.293829:0:6498:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1784045425.293911:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:12470:x1870706863345664:12345-192.168.203.44@tcp:58:lfs.0 Request processed in 308us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045425.293918:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 230 00000100:00100000:3.0:1784045425.303552:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045425.303706:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863345792 00000100:00100000:0.0:1784045425.303717:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863345792 00000100:00100000:0.0:1784045425.303781:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 231 00000100:00100000:0.0:1784045425.303791:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+65:12470:x1870706863345792:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:0.0:1784045425.303822:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045425.303845:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d55c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.303913:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d555 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.303924:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d55c lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f219 expref: 66 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.303943:0:6497:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d555 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.303959:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d55c lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f219 expref: 66 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.303972:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:0.0:1784045425.303976:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784045425.303980:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d55c lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f219 expref: 66 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045425.303988:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b2c00, rc 0) 00000100:00100000:0.0:1784045425.304055:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+66:12470:x1870706863345792:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 266us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045425.304062:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 231 00010000:00010000:3.0:1784045425.625095:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784045426.131678:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045426.131688:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045426.131717:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1784045426.131728:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784045426.131867:0:13774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841fdf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1870706873886464:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784045426.131998:0:13774:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c883063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045426.144660:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045426.144862:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863345920 00000100:00100000:1.0:1784045426.144873:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863345920 00000100:00100000:0.0:1784045426.144965:0:13774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841fdf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1870706873886464:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784045426.144967:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 232 00000100:00100000:1.0:1784045426.144983:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:12471:x1870706863345920:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784045426.145014:0:6498:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784045426.145137:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+66:12471:x1870706863345920:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 157us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045426.145145:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 232 00000100:00080000:2.0:1784045426.145238:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045426.148019:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045426.148236:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863346048 00000100:00100000:0.0:1784045426.148246:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863346048 00000100:00100000:0.0:1784045426.148323:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 233 00000100:00100000:0.0:1784045426.148335:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+66:12471:x1870706863346048:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784045426.148404:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d563 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148420:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d563 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148433:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d563 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148490:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454d56a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148498:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454d56a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148504:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454d56a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148538:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d571 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148564:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148571:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045426.148635:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784045426.148640:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784045426.148654:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148664:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d563 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148669:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d563 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148675:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d563 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148683:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045426.148686:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d563 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148693:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d563 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148704:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c813ee300) 00010000:00010000:0.0:1784045426.148707:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045426.148712:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d563 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148728:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d563 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148742:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454d56a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148747:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454d56a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148752:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454d56a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148758:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045426.148761:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454d56a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148767:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454d56a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148774:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff939c813ee400) 00010000:00010000:0.0:1784045426.148776:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045426.148779:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454d56a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148784:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3400/0x5475624df454d56a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148797:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d571 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148802:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d571 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148813:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d571 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148817:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045426.148820:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d571 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148825:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d571 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148832:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:0.0:1784045426.148834:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045426.148836:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d571 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.148841:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2000/0x5475624df454d571 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045426.148914:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+66:12471:x1870706863346048:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 Request processed in 580us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045426.148922:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 233 00000100:00100000:0.0:1784045426.160256:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045426.160550:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863346304 00000100:00100000:1.0:1784045426.160560:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863346304 00000100:00100000:1.0:1784045426.160625:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 234 00000100:00100000:1.0:1784045426.160635:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+66:12471:x1870706863346304:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045426.160669:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045426.160691:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d578 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f220 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.160792:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d57f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.160807:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d57f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.160817:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d57f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045426.160827:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784045426.161626:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d57f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.161637:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d57f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.161644:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d57f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.161651:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045426.161655:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d57f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.161662:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d57f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.161675:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:1.0:1784045426.161688:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784045426.161693:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d57f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.161700:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d57f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.161746:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d578 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f220 expref: 68 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.161757:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c813ee300) 00010000:00010000:1.0:1784045426.161760:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784045426.161764:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d578 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f220 expref: 68 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.161773:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cd600, rc 0) 00000100:00100000:1.0:1784045426.161896:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:12471:x1870706863346304:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1262us (1650us total) trans 4294967506 rc 301/301 00000100:00100000:1.0:1784045426.161903:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 234 00000100:00100000:3.0:1784045426.173632:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045426.173833:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863346432 00000100:00100000:0.0:1784045426.173842:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863346432 00000100:00100000:0.0:1784045426.173905:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 235 00000100:00100000:0.0:1784045426.173915:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:12471:x1870706863346432:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784045426.173949:0:6497:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784045426.174073:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:12471:x1870706863346432:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 158us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045426.174095:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 235 00000100:00100000:2.0:1784045426.181963:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045426.185185:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863346688 00000100:00100000:3.0:1784045426.185199:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863346688 00000100:00100000:2.0:1784045426.187744:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 236 00000100:00100000:2.0:1784045426.187756:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:12471:x1870706863346688:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045426.187775:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045426.187778:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784045426.187803:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454d51d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f204 expref: 67 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.187824:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:2.0:1784045426.187828:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784045426.187840:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d58d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f227 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784045426.188419:0:6496:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1784045426.188868:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d594 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.188894:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.188921:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.188978:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d58d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f227 expref: 69 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.188994:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d594 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f227 expref: 68 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.189002:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939b8310c000) 00010000:00010000:2.0:1784045426.189005:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045426.189007:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986a00, rc 0) 00000100:00100000:2.0:1784045426.189078:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+68:12471:x1870706863346688:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 1322us (7600us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1784045426.189086:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 236 00000100:00100000:3.0:1784045426.194746:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045426.194959:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863346944 00000100:00100000:1.0:1784045426.194969:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863346944 00000100:00100000:1.0:1784045426.195024:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 237 00000100:00100000:1.0:1784045426.195034:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+68:12471:x1870706863346944:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784045426.195088:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045426.195113:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d594 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f227 expref: 68 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195131:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939b8310c000) 00010000:00010000:1.0:1784045426.195156:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045426.195176:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d5a2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195188:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d5a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195196:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d5a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195208:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d5a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x1ae42e49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195215:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ae42e49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195232:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ae42e49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195345:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d5a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195353:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d5a2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195358:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d5a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195364:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cd600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045426.195368:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d5a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195380:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d5a2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195394:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:1.0:1784045426.195397:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045426.195401:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d5a2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195406:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d5a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195416:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d5a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ae42e49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195421:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d5a9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ae42e49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195427:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d5a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ae42e49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195431:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045426.195433:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d5a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ae42e49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195439:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d5a9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1ae42e49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195642:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x1ae42e49 (ffff939b81924f00) 00010000:00010000:1.0:1784045426.195646:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045426.195649:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d5a9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x1ae42e49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.195655:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc400/0x5475624df454d5a9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x1ae42e49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045426.195781:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:12471:x1870706863346944:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 747us (1041us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784045426.195789:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 237 00000100:00100000:2.0:1784045426.198441:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045426.198694:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863347072 00000100:00100000:3.0:1784045426.198703:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863347072 00000100:00100000:3.0:1784045426.198759:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 238 00000100:00100000:3.0:1784045426.198768:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+67:12471:x1870706863347072:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045426.198788:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045426.198810:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632200/0x5475624df454d5b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f22e expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.198844:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633a00/0x5475624df454d5b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.198856:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633a00/0x5475624df454d5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.198867:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633a00/0x5475624df454d5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.199056:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632200/0x5475624df454d5b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f22e expref: 69 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.199077:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633a00/0x5475624df454d5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f22e expref: 68 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.199084:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939c93a85300) 00010000:00010000:3.0:1784045426.199094:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784045426.199098:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93633a00, rc 0) 00000100:00100000:3.0:1784045426.203692:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+68:12471:x1870706863347072:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 4918us (5251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045426.203703:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 238 00000100:00100000:3.0:1784045426.208681:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045426.208721:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863347328 00000100:00100000:3.0:1784045426.208730:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863347328 00000100:00100000:3.0:1784045426.208785:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 239 00000100:00100000:3.0:1784045426.208796:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+68:12471:x1870706863347328:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045426.208878:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632000/0x5475624df454d5be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.208896:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632000/0x5475624df454d5be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.208909:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632000/0x5475624df454d5be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784045426.209068:0:6497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1784045426.209077:0:6497:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382317632286ns, next at 383317629975ns, rc = 0 00000004:00010000:3.0:1784045426.209127:0:6497:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000549a420c reply state 00000000d0888d94 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632000/0x5475624df454d5be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.209141:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632000/0x5475624df454d5be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.209148:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939c93a85300) 00010000:00010000:3.0:1784045426.209151:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1784045426.209168:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784045426.209269:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+70:12471:x1870706863347328:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 473us (597us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1784045426.209276:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 239 00000100:00100000:3.0:1784045426.213984:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045426.214137:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863347456 00000100:00100000:2.0:1784045426.214146:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863347456 00000100:00100000:2.0:1784045426.214251:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 240 00000100:00100000:2.0:1784045426.214263:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+70:12471:x1870706863347456:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045426.214358:0:6496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045426.214381:0:6496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d5c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f235 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.214438:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f235 expref: 71 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.214559:0:6496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f235 expref: 71 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.214580:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939c93a85300) 00010000:00010000:2.0:1784045426.214583:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045426.214731:0:6496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986e00, rc 0) 00000100:00100000:2.0:1784045426.214827:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+71:12471:x1870706863347456:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 566us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045426.214834:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 240 00000100:00100000:3.0:1784045426.218143:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045426.218419:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863347584 00000100:00100000:1.0:1784045426.218430:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863347584 00000100:00100000:1.0:1784045426.218547:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00100000:1.0:1784045426.218558:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2394:x1870706863347584:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784045426.218768:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:2394:x1870706863347584:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 212us (633us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1784045426.218776:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 70 00000100:00080000:3.0:1784045426.221066:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045426.223136:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045426.223235:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863347840 00000100:00100000:0.0:1784045426.223244:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863347840 00000100:00100000:0.0:1784045426.223308:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:0.0:1784045426.223317:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+71:12471:x1870706863347840:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784045426.223545:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+72:12471:x1870706863347840:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 229us (418us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1784045426.223553:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:1.0:1784045426.226330:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045426.227785:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863348096 00000100:00100000:3.0:1784045426.227799:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863348096 00000100:00100000:3.0:1784045426.227879:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 241 00000100:00100000:3.0:1784045426.227889:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+72:12471:x1870706863348096:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784045426.228019:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+72:12471:x1870706863348096:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 130us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045426.228026:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 241 00000100:00100000:3.0:1784045426.231536:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045426.231787:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863348224 00000100:00100000:1.0:1784045426.231798:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863348224 00000100:00100000:1.0:1784045426.231862:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 242 00000100:00100000:1.0:1784045426.231872:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+72:12471:x1870706863348224:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045426.231900:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045426.231925:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d5cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f23c expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.231995:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d5d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.232009:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.232020:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045426.232080:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784045426.232101:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.232129:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd600/0x5475624df454d5cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f23c expref: 74 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.232146:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f23c expref: 73 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.232154:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939c93a85300) 00010000:00010000:1.0:1784045426.232157:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784045426.232160:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cda00, rc 0) 00000100:00100000:1.0:1784045426.232239:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+73:12471:x1870706863348224:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 367us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045426.232246:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 242 00000100:00100000:2.0:1784045426.236234:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045426.236379:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863348352 00000100:00100000:3.0:1784045426.236389:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863348352 00000100:00100000:3.0:1784045426.236667:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 71 00000100:00100000:3.0:1784045426.236680:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+10:2395:x1870706863348352:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045426.236698:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045426.236717:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028845624/0x5475624df454d5da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f243 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784045426.236742:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a565f71, blocks: 0x0 00010000:00010000:3.0:1784045426.236762:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=382s v=(0 0) 00010000:00010000:3.0:1784045426.236766:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045426.236789:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028845624/0x5475624df454d5da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f243 expref: 11 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.236809:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000028845624/0x5475624df454d5da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f243 expref: 11 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.236821:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93632200, rc 0) 00000100:00100000:3.0:1784045426.236952:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:2395:x1870706863348352:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 201us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045426.236960:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 71 00000100:00100000:3.0:1784045426.240195:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045426.240371:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863348608 00000100:00100000:1.0:1784045426.240381:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863348608 00000100:00100000:1.0:1784045426.240487:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 243 00000100:00100000:1.0:1784045426.240498:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+73:12471:x1870706863348608:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784045426.240756:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+73:12471:x1870706863348608:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 260us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045426.240764:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 243 00000100:00100000:0.0:1784045426.246359:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045426.246464:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863348736 00000100:00100000:2.0:1784045426.246473:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863348736 00000100:00100000:2.0:1784045426.246646:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 72 00000100:00100000:2.0:1784045426.246658:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:12471:x1870706863348736:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045426.246675:0:8648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045426.246693:0:8648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ec19ce7/0x5475624df454d5e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f24a expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.246723:0:8648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000028845624/0x5475624df454d5da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f243 expref: 12 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.246732:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045426.246736:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045426.246742:0:8648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ec19ce7/0x5475624df454d5e1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f24a expref: 12 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.246796:0:8648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000028845624/0x5475624df454d5da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f243 expref: 12 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.246809:0:8648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000028845624/0x5475624df454d5da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f243 expref: 12 pid: 8411 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045426.246822:0:8648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88335180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8648:1870706873886592:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045426.246993:0:8648:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fcd96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045426.256436:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045426.256581:0:8648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88335180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8648:1870706873886592:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045426.256617:0:8648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ec19ce7/0x5475624df454d5e1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f24a expref: 12 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.256640:0:8648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986a00, rc 0) 00000100:00100000:0.0:1784045426.256692:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+12:12471:x1870706863348736:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 10036us (10340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045426.256700:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 72 00000100:00100000:3.0:1784045426.258527:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863348864 00000100:00100000:3.0:1784045426.258539:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863348864 00010000:00010000:3.0:1784045426.258582:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000028845624/0x5475624df454d5da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f243 expref: 12 pid: 8411 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045426.258636:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 101 00000100:00100000:3.0:1784045426.258646:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+12:2394:x1870706863348864:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045426.258661:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045426.258680:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000028845624/0x5475624df454d5da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f243 expref: 12 pid: 8411 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.258693:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000028845624/0x5475624df454d5da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f243 expref: 12 pid: 8411 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.258715:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028845624/0x5475624df454d5da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f243 expref: 12 pid: 8411 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.258746:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045426.258751:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045426.258758:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ec19ce7/0x5475624df454d5e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f24a expref: 11 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.258767:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ec19ce7/0x5475624df454d5e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f24a expref: 11 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.258802:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005ec19ce7/0x5475624df454d5e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f24a expref: 11 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045426.258815:0:6481:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83380a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1870706873886720:192.168.203.44@tcp:105: 00000100:00100000:3.0:1784045426.258904:0:6481:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045426.264929:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045426.265089:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863348992 00000100:00100000:0.0:1784045426.265105:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863348992 00000100:00100000:3.0:1784045426.265116:0:6481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83380a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6481:1870706873886720:192.168.203.44@tcp:105: 00010000:00010000:3.0:1784045426.265144:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1784045426.265159:0:8417:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff939b841f2680 x1870706863348992/t0(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:67/0 lens 504/0 e 0 to 0 dl 1784045437 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784045426.265169:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b841f2680 with x1870706863348992 ext(0->12) 00002000:00010000:0.0:1784045426.265173:0:8417:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939b841f2680 00000100:00100000:3.0:1784045426.265195:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+12:2394:x1870706863348864:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 6551us (8768us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045426.265203:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:3.0:1784045426.265204:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 101 00000100:00100000:0.0:1784045426.265237:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+11:2394:x1870706863348992:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784045426.266395:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+13:2394:x1870706863348992:12345-192.168.203.44@tcp:4:lhsmtool_posix.0 Request processed in 1154us (1468us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1784045426.266405:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00002000:00100000:0.0:1784045426.266414:0:8417:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff939b841f2680 x1870706863348992/t4294967321(0) o4->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:67/0 lens 504/448 e 0 to 0 dl 1784045437 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784045426.266424:0:8417:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b841f2680 with x1870706863348992 ext(0->12) 00002000:00010000:0.0:1784045426.266428:0:8417:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939b841f2680 00000100:00100000:1.0:1784045426.280441:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045426.281395:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863349120 00000100:00100000:2.0:1784045426.281406:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863349120 00000100:00100000:2.0:1784045426.281493:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 244 00000100:00100000:2.0:1784045426.281503:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+73:12471:x1870706863349120:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1784045426.286669:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:1.0:1784045426.286711:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:1.0:1784045426.286755:0:6475:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1784045426.286783:0:6475:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939b83700900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1784045426.286788:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939b833ff800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff939b837000c0 00000020:00080000:1.0:1784045426.286791:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939c91b89000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939b8348dc00 00000020:00080000:1.0:1784045426.286839:0:6475:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939b828c9540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1784045426.286843:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939cb58c9200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff939b828c9f00 00000020:00080000:1.0:1784045426.286846:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939cb58c9900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939b810fee00 00000100:00100000:1.0:1784045426.288888:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873886848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784045426.288961:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045426.289196:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873886976:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784045426.289236:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045426.289265:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873887104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784045426.289297:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045426.289328:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873886848 00000100:00100000:2.0:1784045426.289334:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873886848 00000100:00100000:2.0:1784045426.289375:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873886976 00000100:00100000:2.0:1784045426.289377:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873886976 00000100:00100000:2.0:1784045426.289394:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873887104 00000100:00100000:2.0:1784045426.289396:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873887104 00000100:00100000:2.0:1784045426.289408:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784045426.289414:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3625:x1870706873886848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784045426.289481:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:2.0:1784045426.289508:0:8413:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a565f70, atime: 0x6a565f70, ctime: 0x6a565f70, blocks: 0x8 00010000:00010000:2.0:1784045426.289622:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff13b576/0x5475624df454d5e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.289640:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1784045426.289645:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045426.289652:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff13b576/0x5475624df454d5e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.289668:0:8413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff13b576/0x5475624df454d5e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.289678:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff13b576/0x5475624df454d5e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.289687:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff13b576/0x5475624df454d5e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.289702:0:8413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784045426.289827:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3625:x1870706873886848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 412us (866us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784045426.289834:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784045426.289851:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784045426.289856:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3626:x1870706873886976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784045426.289868:0:8413:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00000100:00100000:3.0:1784045426.289981:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784045426.289991:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3623:x1870706873887104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1784045426.290071:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1784045426.290075:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1784045425 00002000:00010000:3.0:1784045426.290078:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784045426.290080:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1784045425 -> 1784045425 00002000:00010000:3.0:1784045426.290090:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1784045426.290129:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3623:x1870706873887104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 141us (831us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1784045426.290136:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1784045426.290157:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045426.290161:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784045426.290169:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045426.290175:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff13b576/0x5475624df454d5e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.290185:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986800 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045426.290189:0:7904:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff13b576/0x5475624df454d5e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.290199:0:7904:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff13b576/0x5475624df454d5e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.290216:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff13b576/0x5475624df454d5e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.290234:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff13b576/0x5475624df454d5e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.290254:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045426.290256:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045426.290257:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784045426.290293:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939c88336d80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1784045426.290299:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873887104:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1784045426.290394:0:8413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.290410:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009677f31/0x5475624df454d39c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1a2 expref: 12 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.290417:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784045426.290421:0:8413:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045426.290425:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.290482:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009677f31/0x5475624df454d39c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1a2 expref: 12 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.290496:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009677f31/0x5475624df454d39c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1a2 expref: 12 pid: 8412 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045426.290509:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88335c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8413:1870706873887232:192.168.203.44@tcp:104: 00000004:00080000:1.0:1784045426.290624:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939b83380a80/2, rc 0, transno 4294967311 00000100:00100000:1.0:1784045426.290630:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873886848:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784045426.290714:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fcd9a80 going to sleep for 11 seconds 00000020:00080000:1.0:1784045426.291539:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1784045426.291604:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1784045426.293239:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:12471:x1870706863349120:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 Request processed in 11730us (12797us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045426.293252:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 244 00000001:00080000:1.0:1784045426.295813:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1784045426.295829:0:9491:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:0.0:1784045426.295937:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2e6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.295950:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2e6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.295958:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.295964:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045426.295969:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2e6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.295976:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2e6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.295993:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff939b8310ce00) 00010000:00010000:0.0:1784045426.295996:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045426.296000:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2e6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296026:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454d2e6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296063:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d38e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296069:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d38e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296074:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d38e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296078:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987800 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045426.296082:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d38e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296087:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d38e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296096:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff939b8310c600) 00010000:00010000:0.0:1784045426.296098:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045426.296101:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d38e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296106:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987800/0x5475624df454d38e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296120:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d40c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296126:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d40c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296142:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d40c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296148:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045426.296151:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d40c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296157:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d40c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296168:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c200) 00010000:00010000:0.0:1784045426.296170:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045426.296172:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d40c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296178:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d40c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296191:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d42f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296197:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d42f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296203:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d42f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296208:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045426.296211:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d42f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296240:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d42f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296248:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b8310c200) 00010000:00010000:0.0:1784045426.296251:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045426.296253:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d42f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296259:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454d42f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296727:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d501 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296737:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d501 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296742:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d501 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296747:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045426.296750:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d501 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296756:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d501 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296766:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:0.0:1784045426.296768:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045426.296771:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d501 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296787:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc200/0x5475624df454d501 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296800:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632000/0x5475624df454d5be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296805:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632000/0x5475624df454d5be lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296811:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632000/0x5475624df454d5be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296815:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93632000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045426.296818:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632000/0x5475624df454d5be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296824:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632000/0x5475624df454d5be lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296833:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939c93a85300) 00010000:00010000:0.0:1784045426.296835:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784045426.296838:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632000/0x5475624df454d5be lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.296843:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93632000/0x5475624df454d5be lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045426.304650:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045426.304727:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045426.304854:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88335c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8413:1870706873887232:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045426.304882:0:8413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045426.305211:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863349248 00000100:00100000:3.0:1784045426.305231:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863349248 00000100:00100000:3.0:1784045426.305292:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 76 00000100:00100000:3.0:1784045426.305302:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+13:2394:x1870706863349248:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1784045426.306144:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863349376 00000100:00100000:0.0:1784045426.306151:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863349376 00010000:00010000:0.0:1784045426.306181:0:6483:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009677f31/0x5475624df454d39c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1a2 expref: 14 pid: 8412 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045426.306336:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 102 00000100:00100000:0.0:1784045426.306345:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+14:2394:x1870706863349376:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045426.306357:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045426.306363:0:6483:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009677f31/0x5475624df454d39c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1a2 expref: 14 pid: 8412 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.306377:0:6483:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009677f31/0x5475624df454d39c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1a2 expref: 14 pid: 8412 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.306398:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009677f31/0x5475624df454d39c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1a2 expref: 14 pid: 8412 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.306414:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784045426.306418:0:6483:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784045426.306423:0:6483:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.306433:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.306495:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045426.306626:0:8413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.306637:0:8413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.306647:0:8413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.306662:0:8413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.306680:0:8413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045426.306734:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045426.306740:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.306747:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986200 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045426.306751:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.306759:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.306771:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.306778:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d79ef06/0x5475624df454d5ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.306794:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045426.306795:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045426.306797:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045426.306914:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+13:2394:x1870706863349376:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 568us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045426.306922:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 102 00000100:00100000:1.0:1784045426.307542:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3626:x1870706873886976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17683us (18303us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1784045426.307560:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:3.0:1784045426.314046:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939c88334a80/2, rc 0, transno 4294967323 00000100:00100000:3.0:1784045426.314064:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873886976:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1784045426.324047:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1784045426.324062:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1784045426.324286:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863349248:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 Request processed in 18978us (19639us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045426.324302:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 76 00000100:00100000:3.0:1784045426.331780:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045426.331891:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863349632 00000100:00100000:0.0:1784045426.331901:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863349632 00000100:00100000:0.0:1784045426.331960:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 245 00000100:00100000:0.0:1784045426.331970:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:12471:x1870706863349632:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784045426.332021:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045426.332046:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d5d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f23c expref: 21 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.332069:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939c93a85300) 00010000:00010000:0.0:1784045426.332074:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045426.332101:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454d5f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.332113:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454d5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.332122:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454d5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045426.332253:0:6497:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f78bbf6 reply state 000000009c1580f6 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454d5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.332266:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454d5f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.332272:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939c93a85300) 00010000:00010000:0.0:1784045426.332274:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784045426.332277:0:6497:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045426.332420:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:12471:x1870706863349632:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 450us (646us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1784045426.332702:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 245 00000100:00100000:3.0:1784045426.334432:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045426.334601:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863349760 00000100:00100000:2.0:1784045426.334610:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863349760 00000100:00100000:2.0:1784045426.334657:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 77 00000100:00100000:2.0:1784045426.334666:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2394:x1870706863349760:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784045426.334804:0:9935:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1784045426.334807:0:9935:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1784045425 -> 1784045424 00002000:00010000:2.0:1784045426.334809:0:9935:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1784045424 00002000:00010000:2.0:1784045426.334811:0:9935:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1784045425 -> 1784045424 00002000:00010000:2.0:1784045426.334812:0:9935:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1784045426.334857:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2394:x1870706863349760:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 192us (431us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1784045426.334868:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 77 00000100:00100000:1.0:1784045426.336870:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045426.337059:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863350016 00000100:00100000:0.0:1784045426.337068:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863350016 00000100:00100000:0.0:1784045426.337128:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 246 00000100:00100000:0.0:1784045426.337137:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:12471:x1870706863350016:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1784045426.337204:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.337232:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633a00/0x5475624df454d5b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f22e expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.337242:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.337276:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633a00/0x5475624df454d5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f22e expref: 22 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.337290:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633a00/0x5475624df454d5b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f22e expref: 22 pid: 6498 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045426.337303:0:6496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873887360:192.168.203.44@tcp:104: 00000100:00100000:0.0:1784045426.337398:0:6496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c88306000 going to sleep for 11 seconds 00000100:00100000:0.0:1784045426.339763:0:6496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6496:1870706873887360:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045426.339795:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045426.347514:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045426.348037:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863350144 00000100:00100000:2.0:1784045426.348047:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863350144 00010000:00010000:2.0:1784045426.348087:0:9500:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633a00/0x5475624df454d5b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f22e expref: 23 pid: 6498 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045426.348169:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 103 00000100:00100000:2.0:1784045426.348179:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+23:2395:x1870706863350144:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045426.348194:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045426.348200:0:9500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633a00/0x5475624df454d5b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f22e expref: 23 pid: 6498 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.348213:0:9500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633a00/0x5475624df454d5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f22e expref: 23 pid: 6498 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.348261:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633a00/0x5475624df454d5b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f22e expref: 23 pid: 6498 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.348278:0:9500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939c93a85300) 00010000:00010000:2.0:1784045426.348283:0:9500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.348292:0:9500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.348299:0:9500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.348319:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045426.348376:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:2395:x1870706863350144:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 198us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045426.348384:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 103 00010000:00010000:0.0:1784045426.349075:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.349093:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.349130:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.349136:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.349142:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.349147:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045426.349151:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.349157:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.349168:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939c93a85300) 00010000:00010000:0.0:1784045426.349171:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1784045426.349174:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.349179:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d5fd lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045426.349256:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:12471:x1870706863350016:12345-192.168.203.44@tcp:55:lhsmtool_posix.0 Request processed in 12119us (12392us total) trans 0 rc -22/-22 00000100:00100000:0.0:1784045426.349265:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 246 00000100:00100000:1.0:1784045426.361306:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045426.361384:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863350272 00000100:00100000:2.0:1784045426.361395:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863350272 00000100:00100000:2.0:1784045426.361481:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 78 00000100:00100000:2.0:1784045426.361502:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2395:x1870706863350272:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784045426.361545:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.361566:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ec19ce7/0x5475624df454d5e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f24a expref: 8 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.361591:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045426.361596:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045426.361600:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.361636:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ec19ce7/0x5475624df454d5e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f24a expref: 8 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.361650:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ec19ce7/0x5475624df454d5e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f24a expref: 8 pid: 8648 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045426.361666:0:8411:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88335c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8411:1870706873887488:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045426.361744:0:8411:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fcd9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784045426.370627:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045426.370951:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863350400 00000100:00100000:3.0:1784045426.370960:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863350400 00010000:00010000:3.0:1784045426.370999:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ec19ce7/0x5475624df454d5e1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f24a expref: 9 pid: 8648 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045426.371047:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 104 00000100:00100000:3.0:1784045426.371056:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2395:x1870706863350400:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045426.371070:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045426.371092:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ec19ce7/0x5475624df454d5e1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f24a expref: 9 pid: 8648 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.371106:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ec19ce7/0x5475624df454d5e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f24a expref: 9 pid: 8648 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.371130:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045426.371135:0:6482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045426.371155:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.371165:0:6482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.371184:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045426.371246:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+9:2395:x1870706863350400:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 191us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045426.371254:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 104 00010000:00010000:2.0:1784045426.371643:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ec19ce7/0x5475624df454d5e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f24a expref: 8 pid: 8648 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045426.371660:0:8411:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88335c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8411:1870706873887488:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045426.371680:0:8411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.371691:0:8411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.371699:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.371727:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.371735:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.371743:0:8411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.371749:0:8411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987200 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045426.371754:0:8411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.371763:0:8411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.371784:0:8411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.371792:0:8411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e29d171/0x5475624df454d604 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045426.371847:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863350272:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 Request processed in 10348us (10551us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045426.371855:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 78 00000100:00100000:3.0:1784045426.379597:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045426.379717:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863350656 00000100:00100000:0.0:1784045426.379728:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863350656 00000100:00100000:0.0:1784045426.379794:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 247 00000100:00100000:0.0:1784045426.379804:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:12471:x1870706863350656:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784045426.379877:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.379895:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d4fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f1f6 expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.379905:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.379937:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d4fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1f6 expref: 21 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.379952:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d4fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1f6 expref: 21 pid: 6497 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045426.379966:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873887616:192.168.203.44@tcp:104: 00000100:00100000:0.0:1784045426.380047:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c88306000 going to sleep for 11 seconds 00000100:00100000:1.0:1784045426.395115:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045426.395254:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863350784 00000100:00100000:3.0:1784045426.395264:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863350784 00010000:00010000:3.0:1784045426.395304:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d4fa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1f6 expref: 22 pid: 6497 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045426.395354:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 105 00000100:00100000:3.0:1784045426.395364:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:2394:x1870706863350784:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045426.395380:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045426.395387:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d4fa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1f6 expref: 22 pid: 6497 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.395404:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d4fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1f6 expref: 22 pid: 6497 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.395428:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:3.0:1784045426.395434:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d55c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f219 expref: 22 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.395511:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.395520:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.395528:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.395549:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045426.395599:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:2394:x1870706863350784:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 236us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045426.395608:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 105 00010000:00010000:0.0:1784045426.396546:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454d4fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f1f6 expref: 21 pid: 6497 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045426.396569:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873887616:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045426.396595:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.396620:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.396626:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.396805:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.396817:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d5c5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f235 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.396824:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.396854:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d5c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f235 expref: 21 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.396867:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d5c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f235 expref: 21 pid: 6496 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045426.396880:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873887744:192.168.203.44@tcp:104: 00000100:00100000:0.0:1784045426.396953:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c88306cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045426.400807:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045426.400891:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863350912 00000100:00100000:3.0:1784045426.400900:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863350912 00010000:00010000:3.0:1784045426.400937:0:6482:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d5c5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f235 expref: 22 pid: 6496 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045426.400985:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 106 00000100:00100000:3.0:1784045426.400993:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:2395:x1870706863350912:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045426.401007:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045426.401013:0:6482:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d5c5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f235 expref: 22 pid: 6496 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.401024:0:6482:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d5c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f235 expref: 22 pid: 6496 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.401066:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939c93a85300) 00010000:00010000:3.0:1784045426.401070:0:6482:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.401079:0:6482:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.401087:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.401105:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045426.406197:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986e00/0x5475624df454d5c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f235 expref: 22 pid: 6496 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045426.406234:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873887744:192.168.203.44@tcp:104: 00010000:00010000:0.0:1784045426.406260:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.406309:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.406316:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784045426.406427:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1784045426.406576:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:0.0:1784045426.406611:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1784045426.406675:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10615:1870706873887872:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784045426.406735:0:10615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045426.406776:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c883063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045426.406895:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe48050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:2395:x1870706863350912:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 5900us (6094us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045426.406907:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 106 00000100:00100000:3.0:1784045426.407646:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873887872 00000100:00100000:3.0:1784045426.407658:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873887872 00000100:00100000:3.0:1784045426.407724:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784045426.407733:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10615:x1870706873887872:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784045426.407984:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:10615:x1870706873887872:12345-0@lo:1000:mdt00_003.0 Request processed in 252us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045426.407992:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784045426.408063:0:10615:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1784045426.408070:0:10615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:0.0:1784045426.408086:0:10615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939c88336d80, transno 4294967322 00000100:00100000:0.0:1784045426.408107:0:10615:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff939c88334a80 x1870706873886976/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784045442 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045426.408119:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10615:1870706873887872:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1784045426.408263:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:0.0:1784045426.408590:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10615:1870706873888000:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784045426.408625:0:10615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045426.408656:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c88306180 going to sleep for 11 seconds 00000100:00100000:2.0:1784045426.408960:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873888000 00000100:00100000:2.0:1784045426.408967:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873888000 00000100:00100000:2.0:1784045426.409006:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1784045426.409012:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10615:x1870706873888000:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784045426.409132:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:10615:x1870706873888000:12345-0@lo:1000:mdt00_003.0 Request processed in 120us (506us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1784045426.409138:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784045426.409657:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10615:1870706873888000:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1784045426.409692:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409699:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409704:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409710:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045426.409714:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409721:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409737:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939c93a85300) 00010000:00010000:1.0:1784045426.409756:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045426.409761:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409768:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3600/0x5475624df454d612 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409793:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d555 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409799:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d555 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409805:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d555 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409810:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cd400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045426.409812:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d555 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409819:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d555 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409828:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:1.0:1784045426.409830:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784045426.409836:0:10615:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d55c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f219 expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409847:0:10615:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d55c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f219 expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.409856:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d55c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f219 expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.410268:0:10615:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d55c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f219 expref: 24 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045426.410439:0:10615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873888128:192.168.203.44@tcp:105: 00000100:00100000:1.0:1784045426.410545:0:10615:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c9180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045426.414953:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045426.415010:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863351040 00000100:00100000:3.0:1784045426.415018:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863351040 00000100:00100000:0.0:1784045426.415032:0:10615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1870706873888128:192.168.203.44@tcp:105: 00010000:00010000:0.0:1784045426.415056:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d555 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415067:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d555 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045426.415072:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:3.0:1784045426.415081:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:12470:x1870706863351040:12345-192.168.203.44@tcp:49:lfs.0 00010000:00010000:0.0:1784045426.415114:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d619 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415127:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d619 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415136:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d619 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415145:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d619 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415150:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d619 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415156:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d619 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415161:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045426.415164:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d619 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415171:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d619 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415180:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:0.0:1784045426.415184:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045426.415187:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d619 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415193:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3a00/0x5475624df454d619 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045426.415200:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+25:12470:x1870706863351040:12345-192.168.203.44@tcp:49:lfs.0 Request processed in 119us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045426.415208:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 61 00010000:00010000:0.0:1784045426.415209:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415214:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415232:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415237:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045426.415240:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415246:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415259:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:0.0:1784045426.415261:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784045426.415264:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.415270:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3e00/0x5475624df454d60b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784045426.415642:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045426.415646:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1784045426.415664:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:12471:x1870706863350656:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 35860us (36075us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1784045426.415672:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 247 00000020:00080000:1.0:1784045426.415675:0:10615:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1784045426.416518:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1784045426.416530:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784045426.418258:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045426.419371:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863351296 00000100:00100000:2.0:1784045426.419384:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863351296 00000100:00100000:0.0:1784045426.419570:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 248 00000100:00100000:0.0:1784045426.419583:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:12470:x1870706863351296:12345-192.168.203.44@tcp:58:lfs.0 00000040:00080000:0.0:1784045426.419753:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1784045426.419839:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:12470:x1870706863351296:12345-192.168.203.44@tcp:58:lfs.0 Request processed in 260us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045426.419865:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 248 00000100:00100000:0.0:1784045426.420234:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045426.422072:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863351552 00000100:00100000:3.0:1784045426.422085:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863351552 00000100:00100000:3.0:1784045426.422209:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:3.0:1784045426.422230:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c98559050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+24:12471:x1870706863351552:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784045426.422538:0:6500:0:(mdd_object.c:4016:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784045426.422568:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:3.0:1784045426.422601:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633600/0x5475624df454d620 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.422615:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633600/0x5475624df454d620 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.422626:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633600/0x5475624df454d620 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.422634:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633600/0x5475624df454d620 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.422640:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633600/0x5475624df454d620 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.422646:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633600/0x5475624df454d620 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045426.422669:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784045426.422769:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c98559050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+26:12471:x1870706863351552:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 550us (2535us total) trans 4294967517 rc 0/0 00010000:00010000:2.0:1784045426.424145:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045426.424156:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633600/0x5475624df454d620 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.424167:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93633600 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045426.424171:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633600/0x5475624df454d620 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.424179:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633600/0x5475624df454d620 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.424195:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939c93a85300) 00010000:00010000:2.0:1784045426.424197:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784045426.424227:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633600/0x5475624df454d620 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.424234:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633600/0x5475624df454d620 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045426.424250:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045426.424252:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045426.424253:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045426.424813:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 62 00000020:00080000:3.0:1784045426.424821:0:6500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784045426.446429:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045426.446626:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863351680 00000100:00100000:1.0:1784045426.446635:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863351680 00000100:00100000:1.0:1784045426.446686:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 249 00000100:00100000:1.0:1784045426.446694:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+26:12473:x1870706863351680:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1784045426.446718:0:6497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045426.446737:0:6497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454d627 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f251 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.446797:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454d62e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.446811:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454d62e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.446822:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454d62e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.446857:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d635 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.446864:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d635 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.446872:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d635 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.446957:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d63c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.446968:0:6497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f212 expref: 27 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.446992:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d63c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.447025:0:6497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f212 expref: 27 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.447037:0:6497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f212 expref: 27 pid: 10615 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045426.447052:0:6497:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873888256:192.168.203.44@tcp:104: 00000100:00100000:1.0:1784045426.447142:0:6497:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c9480 going to sleep for 11 seconds 00000100:00100000:3.0:1784045426.450477:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045426.450624:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863351936 00000100:00100000:0.0:1784045426.450634:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863351936 00000100:00100000:0.0:1784045426.450694:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:0.0:1784045426.450704:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+28:6164:x1870706863351936:12345-192.168.203.44@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784045426.450936:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:6164:x1870706863351936:12345-192.168.203.44@tcp:35:ldlm_bl.0 Request processed in 233us (500us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1784045426.450945:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:1.0:1784045426.451628:0:6497:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6497:1870706873888256:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045426.451652:0:6497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d63c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045426.456260:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045426.456503:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863352064 00000100:00100000:0.0:1784045426.456512:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863352064 00010000:00010000:0.0:1784045426.456554:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f212 expref: 29 pid: 10615 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045426.456660:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 107 00000100:00100000:0.0:1784045426.456670:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:2394:x1870706863352064:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045426.456685:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045426.456692:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f212 expref: 29 pid: 10615 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.456706:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f212 expref: 29 pid: 10615 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.456727:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633800/0x5475624df454d547 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f212 expref: 29 pid: 10615 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.456763:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:0.0:1784045426.456769:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d63c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.456778:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d63c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.456787:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d63c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045426.456811:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045426.456866:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+28:2394:x1870706863352064:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 196us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045426.456873:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 107 00010000:00010000:1.0:1784045426.458058:0:6497:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d63c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458068:0:6497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d63c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045426.458116:0:6497:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1784045426.458120:0:6497:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784045426.458138:0:6497:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d63c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458150:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d63c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458160:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454d62e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458167:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454d62e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458174:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454d62e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458179:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045426.458184:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454d62e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458191:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454d62e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458203:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:1.0:1784045426.458230:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045426.458235:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454d62e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458242:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc000/0x5475624df454d62e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458256:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d635 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458261:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d635 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458267:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d635 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458272:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cd000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045426.458275:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d635 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458281:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d635 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458288:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff939b81925d00) 00010000:00010000:1.0:1784045426.458291:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045426.458293:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d635 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458299:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454d635 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458335:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cce00/0x5475624df454d627 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f251 expref: 28 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458363:0:6497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d63c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f251 expref: 27 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045426.458371:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:1.0:1784045426.458374:0:6497:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784045426.458376:0:6497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cd400, rc 0) 00000100:00100000:1.0:1784045426.458438:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:12473:x1870706863351680:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 11742us (12016us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045426.458470:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 249 00010000:00010000:1.0:1784045426.643827:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784045427.278480:0:14737:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045427.278488:0:14737:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045427.278520:0:14737:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784045427.278530:0:14737:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784045427.349271:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873888384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045427.349344:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045427.349409:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873888384 00000100:00100000:3.0:1784045427.349416:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873888384 00000100:00100000:3.0:1784045427.349482:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784045427.349492:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1870706873888384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045427.349515:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1784045427.349557:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1870706873888384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045427.349580:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784045427.349628:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873888384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045427.362709:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045427.362732:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873888512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784045427.362797:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045427.374050:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873888512 00000100:00100000:0.0:1784045427.374065:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873888512 00000100:00100000:0.0:1784045427.374146:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784045427.374157:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873888512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784045427.374185:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:0.0:1784045427.374280:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873888512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (11482us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045427.374288:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784045427.374341:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873888512:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784045427.374475:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1784045427.475646:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045427.475657:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045427.475696:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1784045427.475703:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784045427.475851:0:13774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88334700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1870706873888640:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784045427.475950:0:13774:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fcd9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045427.478793:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045427.478840:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863352192 00000100:00100000:3.0:1784045427.478848:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863352192 00000100:00100000:3.0:1784045427.478907:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 250 00000100:00100000:3.0:1784045427.478917:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+28:12485:x1870706863352192:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784045427.478951:0:6496:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784045427.479051:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+28:12485:x1870706863352192:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 135us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045427.479058:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 250 00000100:00100000:0.0:1784045427.479181:0:13774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88334700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13774:1870706873888640:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784045427.486834:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045427.486934:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863352448 00000100:00100000:2.0:1784045427.486944:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863352448 00000100:00100000:2.0:1784045427.487006:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 251 00000100:00100000:2.0:1784045427.487016:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+27:12485:x1870706863352448:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045427.487034:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045427.487056:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d643 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f258 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045427.487178:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d64a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045427.487193:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d64a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045427.487206:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d64a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045427.487237:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784045427.487352:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986200/0x5475624df454d643 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f258 expref: 30 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045427.487370:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d64a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f258 expref: 29 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045427.487379:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:2.0:1784045427.487381:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045427.487385:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986c00, rc 0) 00000100:00100000:2.0:1784045427.487437:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:12485:x1870706863352448:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 422us (609us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1784045427.487468:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 251 00000100:00100000:3.0:1784045427.496235:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045427.500850:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863352576 00000100:00100000:2.0:1784045427.500863:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863352576 00000100:00100000:2.0:1784045427.500928:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:2.0:1784045427.500938:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:2396:x1870706863352576:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045427.500954:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045427.500978:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454d64a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f258 expref: 29 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045427.500997:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:2.0:1784045427.501002:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045427.501071:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+28:2396:x1870706863352576:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 124us (4836us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045427.501079:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:1.0:1784045427.512664:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045427.513731:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863352832 00000100:00100000:3.0:1784045427.513742:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863352832 00000100:00100000:3.0:1784045427.513809:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 252 00000100:00100000:3.0:1784045427.513820:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+28:12485:x1870706863352832:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784045427.513911:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633400/0x5475624df454d658 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045427.513928:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633400/0x5475624df454d658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045427.513940:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633400/0x5475624df454d658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045427.514129:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633400/0x5475624df454d658 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045427.514137:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633400/0x5475624df454d658 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045427.514143:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633400/0x5475624df454d658 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045427.514149:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93633400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045427.514153:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633400/0x5475624df454d658 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045427.514165:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633400/0x5475624df454d658 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045427.514178:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:3.0:1784045427.514181:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784045427.514186:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633400/0x5475624df454d658 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045427.514191:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93633400/0x5475624df454d658 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045427.514344:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:12485:x1870706863352832:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 525us (1687us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1784045427.514352:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 252 00000040:00080000:2.0:1784045427.514373:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784045427.514379:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784045427.514873:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1784045427.514883:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784045427.525872:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045427.529960:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863353088 00000100:00100000:0.0:1784045427.529976:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863353088 00000100:00100000:0.0:1784045427.530048:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:0.0:1784045427.530058:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+29:12485:x1870706863353088:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784045427.530460:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:12485:x1870706863353088:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 383us (4579us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1784045427.530468:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 64 00010000:00010000:1.0:1784045427.667853:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045427.860602:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045427.860641:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873888768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784045427.860716:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045427.861840:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873888768 00000100:00100000:3.0:1784045427.861851:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873888768 00000100:00100000:3.0:1784045427.861937:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1784045427.861949:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873888768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045427.861990:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045427.862184:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873888768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045427.862374:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1784045427.864232:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873888768:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1784045428.180788:0:13778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1784045428.564931:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045428.564939:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045428.564966:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784045428.564975:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784045428.691710:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045428.929631:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045428.929705:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045428.929741:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045428.929771:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045428.929799:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863353728 00000100:00100000:1.0:1784045428.929809:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863353728 00000100:00100000:1.0:1784045428.929879:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 171 00000100:00100000:1.0:1784045428.929889:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863353728:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045428.929968:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863353728:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 80us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045428.929975:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 171 00000100:00100000:1.0:1784045428.930002:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863353472 00000100:00100000:1.0:1784045428.930006:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863353472 00000100:00100000:1.0:1784045428.930031:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863353984 00000100:00100000:1.0:1784045428.930034:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863353984 00000100:00100000:1.0:1784045428.930055:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 343 00000100:00100000:1.0:1784045428.930062:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863353472:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045428.930091:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2395:x1870706863353472:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 30us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045428.930098:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 343 00000100:00100000:1.0:1784045428.930111:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 344 00000100:00100000:1.0:1784045428.930117:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863353984:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045428.930140:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863353984:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 23us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045428.930146:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 344 00000100:00080000:1.0:1784045428.930163:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784045428.930168:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045428.931027:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863353216 00000100:00100000:3.0:1784045428.931035:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863353216 00000100:00100000:3.0:1784045428.931071:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 393 00000100:00100000:3.0:1784045428.931079:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863353216:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045428.931121:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863353216:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 43us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045428.931127:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 393 00000100:00100000:1.0:1784045428.931381:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045428.931502:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045428.931533:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045428.931555:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863353344 00000100:00100000:1.0:1784045428.931559:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863353344 00000100:00100000:1.0:1784045428.931604:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863353856 00000100:00100000:1.0:1784045428.931608:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863353856 00000100:00100000:1.0:1784045428.931627:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 345 00000100:00100000:1.0:1784045428.931635:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:2395:x1870706863353344:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045428.931681:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:2395:x1870706863353344:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 46us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045428.931688:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 345 00000100:00100000:1.0:1784045428.931705:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 346 00000100:00100000:1.0:1784045428.931712:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863353856:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045428.931736:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863353856:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 25us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045428.931742:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 346 00000100:00080000:1.0:1784045428.931763:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045428.932152:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863353600 00000100:00100000:3.0:1784045428.932157:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863353600 00000100:00100000:3.0:1784045428.932250:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 172 00000100:00100000:3.0:1784045428.932258:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863353600:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045428.932295:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863353600:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 38us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045428.932313:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 172 00000100:00080000:1.0:1784045428.932432:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1784045429.241679:0:14789:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784045429.241688:0:14789:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784045429.241718:0:14789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784045429.241728:0:14789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784045429.408628:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873889024:0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.408686:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045429.408732:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873889536:0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.408753:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045429.408768:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873890048:0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.408786:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045429.408796:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873890560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045429.408863:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045429.408888:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1784045429.408894:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873888896:0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.408921:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045429.408947:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873889152:0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.408949:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873889408:0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.408994:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045429.409009:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873889024 00000100:00100000:1.0:1784045429.409018:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873889024 00000100:00100000:3.0:1784045429.409021:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873889920:0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.409064:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873889536 00000100:00100000:3.0:1784045429.409067:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045429.409069:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873889536 00000100:00100000:3.0:1784045429.409088:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873890432:0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.409101:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873890048 00000100:00100000:1.0:1784045429.409105:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873890048 00000100:00100000:3.0:1784045429.409115:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045429.409129:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1784045429.409139:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873889024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.409145:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873889280:0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.409164:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045429.409173:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873889792:0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.409519:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873889024:12345-0@lo:400:kworker.0 Request processed in 380us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045429.409527:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1784045429.409547:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873889280 00000100:00100000:1.0:1784045429.409557:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873889280 00000100:00100000:1.0:1784045429.409574:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1784045429.409580:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873889536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.409606:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045429.409635:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873890304:0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.409672:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045429.409707:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873890560 00000100:00100000:3.0:1784045429.409719:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873890560 00000100:00100000:3.0:1784045429.409745:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873889408 00000100:00100000:3.0:1784045429.409747:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873889408 00000100:00100000:3.0:1784045429.409762:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1784045429.409768:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873890560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784045429.409789:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1784045429.409825:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873890560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045429.409832:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1784045429.409853:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1784045429.409861:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873889408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.409897:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873889408:12345-0@lo:400:kworker.0 Request processed in 37us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045429.409904:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1784045429.409925:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873889920 00000100:00100000:3.0:1784045429.409929:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873889920 00000100:00100000:3.0:1784045429.409968:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873890432 00000100:00100000:3.0:1784045429.409972:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873890432 00000100:00100000:3.0:1784045429.410040:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873889792 00000100:00100000:3.0:1784045429.410089:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873889792 00000100:00100000:3.0:1784045429.410114:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873890304 00000100:00100000:3.0:1784045429.410117:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873890304 00000100:00100000:3.0:1784045429.410138:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1784045429.410149:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3624:x1870706873889920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.410192:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3624:x1870706873889920:12345-0@lo:400:kworker.0 Request processed in 46us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045429.410222:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1784045429.410241:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784045429.410250:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873890432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.410279:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873890432:12345-0@lo:400:kworker.0 Request processed in 33us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045429.410366:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1784045429.410381:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1784045429.410388:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873889792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.410420:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873889792:12345-0@lo:400:kworker.0 Request processed in 33us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045429.410425:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1784045429.410434:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1784045429.410439:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873890304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.410488:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873890304:12345-0@lo:400:kworker.0 Request processed in 49us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045429.410494:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1784045429.410534:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873889792:0@lo:400:kworker.0 00000100:00100000:3.0:1784045429.410543:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873890304:0@lo:400:kworker.0 00000100:00100000:2.0:1784045429.411594:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873888896 00000100:00100000:2.0:1784045429.411604:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873888896 00000100:00100000:2.0:1784045429.411654:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1784045429.411662:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873888896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045429.412306:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3624:x1870706873888896:12345-0@lo:400:kworker.0 Request processed in 642us (3381us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045429.412314:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1784045429.413150:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873889536:12345-0@lo:400:kworker.0 Request processed in 3567us (4392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045429.413160:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1784045429.413189:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784045429.413211:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873890048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.413251:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873890048:12345-0@lo:400:kworker.0 Request processed in 56us (4463us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045429.413256:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1784045429.413268:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1784045429.413275:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873889280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.413318:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873889280:12345-0@lo:400:kworker.0 Request processed in 43us (4152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045429.413324:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00080000:1.0:1784045429.413356:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784045429.413361:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784045429.413364:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045429.413388:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045429.413429:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873889664:0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.413476:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045429.413497:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873890176:0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.413514:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045429.413540:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873889664 00000100:00100000:1.0:1784045429.413546:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873889664 00000100:00100000:1.0:1784045429.413576:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873890176 00000100:00100000:1.0:1784045429.413593:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873890176 00000100:00100000:1.0:1784045429.413612:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1784045429.413618:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873889664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.413651:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873889664:12345-0@lo:400:kworker.0 Request processed in 34us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045429.413658:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1784045429.413669:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1784045429.413675:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873890176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.413698:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873890176:12345-0@lo:400:kworker.0 Request processed in 24us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045429.413704:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1784045429.413937:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873889152 00000100:00100000:2.0:1784045429.413943:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873889152 00000100:00100000:2.0:1784045429.413973:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1784045429.413979:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873889152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045429.414016:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873889152:12345-0@lo:400:kworker.0 Request processed in 37us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045429.414022:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1784045429.414253:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873889280:0@lo:400:kworker.0 00000100:00100000:2.0:1784045429.414343:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045429.414397:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863354240 00000100:00100000:1.0:1784045429.414401:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863354240 00000100:00100000:1.0:1784045429.414417:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 253 00000100:00100000:1.0:1784045429.414423:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+30:12506:x1870706863354240:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1784045429.414434:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045429.414538:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d65f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f25f expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045429.414643:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d666 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045429.414658:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d666 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045429.414673:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d666 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045429.414684:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784045429.420738:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cc800/0x5475624df454d65f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f25f expref: 33 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045429.420766:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d666 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f25f expref: 32 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045429.420786:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:1.0:1784045429.420789:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784045429.420793:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cda00, rc 0) 00000100:00100000:1.0:1784045429.420862:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+32:12506:x1870706863354240:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 6436us (6519us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1784045429.420871:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 253 00000100:00080000:1.0:1784045429.420922:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784045429.420972:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873889152:0@lo:400:kworker.0 00010000:00080000:1.0:1784045429.420991:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8d180 x1870706873889664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045429.421003:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873889664:0@lo:400:kworker.0 00010000:00080000:1.0:1784045429.421017:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8d880 x1870706873890176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045429.421025:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873890176:0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.421070:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0e855152-ca69-43a0-b465-3bf4e35d62f0:3624:1870706873888896:0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.421082:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873889408:0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.421097:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873889920:0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.421108:0:3624:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1784045429.421123:0:3624:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:1.0:1784045429.421154:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939b841c5f80, transno 4294967308 00000004:00080000:1.0:1784045429.421171:0:3624:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:1.0:1784045429.421181:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939b83380a80, transno 4294967311 00000100:00100000:1.0:1784045429.421186:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873890432:0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.421219:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873889024:0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.421232:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873889536:0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.421242:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873890048:0@lo:400:kworker.0 00000100:00100000:1.0:1784045429.421258:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873890560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045429.425819:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045429.427323:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863354368 00000100:00100000:0.0:1784045429.427338:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863354368 00000100:00100000:0.0:1784045429.427404:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 254 00000100:00100000:0.0:1784045429.427415:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+32:12506:x1870706863354368:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:0.0:1784045429.427500:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d674 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045429.427516:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d674 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045429.427528:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d674 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045429.427576:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d674 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045429.427582:0:6498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d674 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045429.427588:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d674 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045429.427593:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045429.427597:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d674 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045429.427605:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d674 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045429.427616:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:0.0:1784045429.427619:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784045429.427624:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d674 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045429.427630:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3c00/0x5475624df454d674 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045429.427706:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+32:12506:x1870706863354368:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 293us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045429.427714:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 254 00000100:00100000:3.0:1784045429.536576:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045429.536732:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863354496 00000100:00100000:1.0:1784045429.536742:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863354496 00000100:00100000:2.0:1784045429.536987:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 79 00000100:00100000:2.0:1784045429.536998:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2397:x1870706863354496:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:2.0:1784045429.537016:0:8648:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045429.537036:0:8648:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abc78778/0x5475624df454d67b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f266 expref: -99 pid: 8648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784045429.537080:0:8648:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a565f70, atime: 0x6a565f70, ctime: 0x6a565f70, blocks: 0x8 00010000:00010000:2.0:1784045429.537100:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=385s v=(0 0) 00010000:00010000:2.0:1784045429.537104:0:8648:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045429.537114:0:8648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abc78778/0x5475624df454d67b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f266 expref: 8 pid: 8648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045429.537132:0:8648:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000abc78778/0x5475624df454d67b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f266 expref: 8 pid: 8648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045429.537147:0:8648:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986c00, rc 0) 00000100:00100000:2.0:1784045429.537224:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2397:x1870706863354496:12345-192.168.203.44@tcp:101:cat.0 Request processed in 227us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045429.537231:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 79 00000100:00100000:0.0:1784045429.541534:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045429.541620:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863354624 00000100:00100000:3.0:1784045429.541631:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863354624 00002000:00100000:3.0:1784045429.541679:0:8418:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff939b841fce00 x1870706863354624/t0(0) o3->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:70/0 lens 488/0 e 0 to 0 dl 1784045440 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784045429.541705:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b841fce00 with x1870706863354624 ext(0->4095) 00002000:00010000:3.0:1784045429.541711:0:8418:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939b841fce00 00000100:00100000:3.0:1784045429.541743:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:3.0:1784045429.541752:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2396:x1870706863354624:12345-192.168.203.44@tcp:3:cat.0 00000100:00100000:3.0:1784045429.541943:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+8:2396:x1870706863354624:12345-192.168.203.44@tcp:3:cat.0 Request processed in 191us (505us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1784045429.541952:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00002000:00100000:3.0:1784045429.541959:0:8418:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff939b841fce00 x1870706863354624/t0(0) o3->bbcbf11d-b5f2-42a6-9759-7590eb85aa60@192.168.203.44@tcp:70/0 lens 488/4536 e 0 to 0 dl 1784045440 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784045429.541967:0:8418:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff939b841fce00 with x1870706863354624 ext(0->4095) 00002000:00010000:3.0:1784045429.541971:0:8418:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff939b841fce00 00010000:00010000:1.0:1784045429.716045:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045429.909922:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873890816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045429.909936:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873890688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045429.910684:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045429.910919:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873890688 00000100:00100000:2.0:1784045429.910928:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873890688 00000100:00100000:2.0:1784045429.910969:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784045429.910976:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873890688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045429.911006:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045429.911098:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873890688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045429.911105:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784045429.911254:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873890688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045429.912285:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045429.912411:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873890816 00000100:00100000:1.0:1784045429.912418:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873890816 00000100:00100000:1.0:1784045429.912527:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784045429.912535:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873890816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784045429.912555:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045429.912604:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873890816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045429.912611:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784045429.912684:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873890816:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1784045430.742254:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045431.763637:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784045431.959581:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1784045431.959634:0:6475:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff939c883063c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1784045431.959639:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939c9e611800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff939c88306480 00000020:00080000:1.0:1784045431.959642:0:6475:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff939c9e611e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff939b833f6600 00000020:00080000:1.0:1784045431.959673:0:6475:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1784045431.959740:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1784045431.959821:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1784045431.960162:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454d5f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045431.960174:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454d5f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045431.960181:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454d5f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045431.960199:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045431.960210:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454d5f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045431.960218:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454d5f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045431.960236:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff939c93a85300) 00010000:00010000:3.0:1784045431.960239:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045431.960243:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454d5f6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045431.960249:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2400/0x5475624df454d5f6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6497 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784045431.960630:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1784045431.960638:0:8407:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:0.0:1784045432.468106:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045432.468130:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873890944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045432.468231:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045432.468383:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873890944 00000100:00100000:1.0:1784045432.468392:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873890944 00000100:00100000:2.0:1784045432.468495:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784045432.468509:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873890944:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784045432.468526:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1784045432.468560:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784045432.468621:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873890944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045432.468694:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873890944:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784045432.471412:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873891072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045432.471526:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045432.471736:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873891072 00000100:00100000:3.0:1784045432.471745:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873891072 00000100:00100000:3.0:1784045432.471813:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784045432.471822:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873891072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045432.471844:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:1.0:1784045432.471851:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045432.471899:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873891072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045432.471906:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784045432.471965:0:3624:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1784045432.471971:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939c88334a80, transno 4294967323 00000004:00080000:1.0:1784045432.471982:0:3624:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1784045432.472012:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873891072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045432.473970:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00010000:00010000:1.0:1784045432.787711:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045432.983339:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045432.984138:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873891200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784045432.984218:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045432.984282:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873891200 00000100:00100000:3.0:1784045432.984289:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873891200 00000100:00100000:3.0:1784045432.984662:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1784045432.984679:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873891200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045432.984715:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1784045432.984769:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873891200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045432.984776:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1784045432.984868:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91560380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873891200:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784045433.813805:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045434.056030:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045434.056928:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863354752 00000100:00100000:2.0:1784045434.056944:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863354752 00000100:00100000:2.0:1784045434.057019:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 395 00000100:00100000:2.0:1784045434.057033:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863354752:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045434.057134:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2394:x1870706863354752:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 104us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.057142:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 395 00000100:00100000:1.0:1784045434.058878:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045434.058914:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863354880 00000100:00100000:1.0:1784045434.058924:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863354880 00000100:00100000:1.0:1784045434.058987:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 353 00000100:00100000:1.0:1784045434.058999:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:2394:x1870706863354880:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045434.059077:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:2394:x1870706863354880:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045434.059085:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 353 00000100:00080000:1.0:1784045434.059116:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045434.064628:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045434.064669:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045434.064692:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045434.064711:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045434.064732:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045434.064765:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863355136 00000100:00100000:2.0:1784045434.064777:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863355136 00000100:00100000:2.0:1784045434.065022:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863355264 00000100:00100000:2.0:1784045434.065026:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863355264 00000100:00100000:2.0:1784045434.065055:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 177 00000100:00100000:2.0:1784045434.065065:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863355136:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045434.065144:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863355008 00000100:00100000:3.0:1784045434.065148:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863355008 00000100:00100000:2.0:1784045434.065164:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2395:x1870706863355136:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 100us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.065183:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 177 00000100:00100000:3.0:1784045434.065194:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863355520 00000100:00100000:3.0:1784045434.065197:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863355520 00000100:00100000:2.0:1784045434.065202:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 178 00000100:00100000:3.0:1784045434.065212:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863355392 00000100:00100000:3.0:1784045434.065214:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863355392 00000100:00100000:2.0:1784045434.065216:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863355264:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045434.065231:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 354 00000100:00100000:3.0:1784045434.065237:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863355008:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045434.065245:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863355264:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 30us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.065251:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 178 00000100:00100000:3.0:1784045434.065266:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2394:x1870706863355008:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 29us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.065273:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 355 00000100:00100000:2.0:1784045434.065279:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863355520:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045434.065281:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 354 00000100:00100000:3.0:1784045434.065293:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 356 00000100:00100000:3.0:1784045434.065299:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863355392:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045434.065307:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2394:x1870706863355520:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 28us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.065313:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 355 00000100:00100000:3.0:1784045434.065319:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2395:x1870706863355392:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 20us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045434.065324:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 356 00000100:00080000:2.0:1784045434.065340:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045434.065344:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045434.065347:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045434.065348:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045434.103504:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045434.103608:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863355648 00000100:00100000:2.0:1784045434.103622:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863355648 00000100:00100000:2.0:1784045434.103697:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 255 00000100:00100000:2.0:1784045434.103710:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:12159:x1870706863355648:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784045434.103855:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:12159:x1870706863355648:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 Request processed in 147us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.103864:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 255 00000100:00100000:2.0:1784045434.107570:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045434.107677:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863355776 00000100:00100000:3.0:1784045434.107689:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863355776 00000100:00100000:3.0:1784045434.107770:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 256 00000100:00100000:3.0:1784045434.107784:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:12159:x1870706863355776:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1784045434.107937:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:12159:x1870706863355776:12345-192.168.203.44@tcp:60:lhsmtool_posix.0 Request processed in 154us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045434.107964:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 256 00000100:00100000:0.0:1784045434.112663:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045434.112781:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863356032 00000100:00100000:2.0:1784045434.112795:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863356032 00000100:00100000:2.0:1784045434.112866:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 65 00000100:00100000:2.0:1784045434.112878:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:12159:x1870706863356032:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784045434.113243:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:12159:x1870706863356032:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 365us (593us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1784045434.113252:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 65 00000100:00100000:1.0:1784045434.463272:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045434.463504:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863356160 00000100:00100000:2.0:1784045434.463528:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863356160 00000100:00100000:2.0:1784045434.463606:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 257 00000100:00100000:2.0:1784045434.463619:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:12963:x1870706863356160:12345-192.168.203.44@tcp:101:lsof.0 00010000:00010000:2.0:1784045434.463655:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045434.463686:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d682 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f26d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045434.464187:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d689 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045434.464208:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d689 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045434.464225:0:6498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d689 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045434.464289:0:6498:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784045434.464294:0:6498:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045434.464320:0:6498:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d689 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6498 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045434.464352:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454d682 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f26d expref: 7 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045434.464375:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d689 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f26d expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045434.464402:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85200) 00010000:00010000:2.0:1784045434.464405:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045434.464409:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987200, rc 0) 00000100:00100000:2.0:1784045434.464605:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+6:12963:x1870706863356160:12345-192.168.203.44@tcp:101:lsof.0 Request processed in 988us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.464613:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 257 00000100:00100000:2.0:1784045434.516086:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873891712:0@lo:400:kworker.0 00000100:00100000:2.0:1784045434.516297:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045434.516378:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873892224:0@lo:400:kworker.0 00000100:00100000:2.0:1784045434.516408:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045434.516429:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873892736:0@lo:400:kworker.0 00000100:00100000:2.0:1784045434.516478:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045434.516517:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1784045434.516525:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873891328:0@lo:400:kworker.0 00000100:00100000:2.0:1784045434.516561:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045434.516567:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873891456:0@lo:400:kworker.0 00000100:00100000:2.0:1784045434.516586:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873891840:0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.516599:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045434.516606:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045434.516621:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873891968:0@lo:400:kworker.0 00000100:00100000:2.0:1784045434.516621:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873892352:0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.516641:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045434.516642:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045434.516657:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873892480:0@lo:400:kworker.0 00000100:00100000:2.0:1784045434.516657:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873892864:0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.516676:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045434.516676:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045434.516692:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1784045434.516698:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873891584:0@lo:400:kworker.0 00000100:00100000:2.0:1784045434.516707:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873892224 00000100:00100000:2.0:1784045434.516716:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873892224 00000100:00100000:3.0:1784045434.516723:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045434.516737:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873892096:0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.516756:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045434.516765:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873892608:0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.516782:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045434.516795:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873892736 00000100:00100000:2.0:1784045434.516799:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873892736 00000100:00100000:3.0:1784045434.516801:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873891840 00000100:00100000:3.0:1784045434.516804:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873891840 00000100:00100000:2.0:1784045434.516813:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873892352 00000100:00100000:2.0:1784045434.516815:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873892352 00000100:00100000:3.0:1784045434.516830:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873891584 00000100:00100000:3.0:1784045434.516833:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873891584 00000100:00100000:2.0:1784045434.516842:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873892864 00000100:00100000:2.0:1784045434.516845:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873892864 00000100:00100000:3.0:1784045434.516849:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1784045434.516856:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873891840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045434.516858:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1784045434.516863:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873892224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045434.516949:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873891712 00000100:00100000:0.0:1784045434.516954:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873891712 00000100:00100000:0.0:1784045434.516978:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873891456 00000100:00100000:0.0:1784045434.516981:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873891456 00000100:00100000:0.0:1784045434.516992:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873891968 00000100:00100000:0.0:1784045434.516995:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873891968 00000100:00100000:0.0:1784045434.517007:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873892480 00000100:00100000:0.0:1784045434.517009:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873892480 00000100:00100000:0.0:1784045434.517020:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873892096 00000100:00100000:0.0:1784045434.517023:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873892096 00000100:00100000:0.0:1784045434.517035:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873892608 00000100:00100000:0.0:1784045434.517037:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873892608 00000100:00100000:0.0:1784045434.517050:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1784045434.517055:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873891712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.517093:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873891840:12345-0@lo:400:kworker.0 Request processed in 235us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045434.517101:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1784045434.517123:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1784045434.517131:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c93a53050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873891584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045434.517213:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873891328 00000100:00100000:1.0:1784045434.517219:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873891328 00000100:00100000:1.0:1784045434.517251:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1784045434.517259:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873891328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045434.519383:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873891712:12345-0@lo:400:kworker.0 Request processed in 2313us (3073us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045434.519403:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1784045434.519477:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1784045434.519491:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873891456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.519597:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c93a53050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873891584:12345-0@lo:400:kworker.0 Request processed in 2464us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045434.519607:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1784045434.520201:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873891328:12345-0@lo:400:kworker.0 Request processed in 2938us (3633us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045434.520212:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1784045434.520286:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784045434.520298:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873892736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045434.520353:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873892736:12345-0@lo:400:kworker.0 Request processed in 59us (3875us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045434.520360:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784045434.520381:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784045434.520390:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b830f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873892352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.520490:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784045434.520501:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873892864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.520542:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873892864:12345-0@lo:400:kworker.0 Request processed in 43us (3865us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045434.520549:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784045434.520637:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1784045434.520646:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873891968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.520683:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873891968:12345-0@lo:400:kworker.0 Request processed in 39us (4041us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045434.520690:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1784045434.520705:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1784045434.520712:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873892480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.520743:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873892480:12345-0@lo:400:kworker.0 Request processed in 33us (4067us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045434.520749:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1784045434.520760:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1784045434.520766:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873892096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.520793:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873892096:12345-0@lo:400:kworker.0 Request processed in 28us (4036us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045434.520798:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1784045434.520807:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1784045434.520813:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873892608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.520861:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873892608:12345-0@lo:400:kworker.0 Request processed in 48us (4077us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045434.520867:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1784045434.520912:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873892992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045434.520953:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045434.521009:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873891584:0@lo:400:kworker.0 00010000:00080000:3.0:1784045434.521027:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c812adc00 x1870706873892096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045434.521037:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873892096:0@lo:400:kworker.0 00010000:00080000:3.0:1784045434.521049:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c812afb80 x1870706873892608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045434.521056:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873892608:0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.521068:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873891968:0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.521076:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873892480:0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.521136:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873891328:0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.521150:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873891840:0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.521161:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873892864:0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.522618:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873891712:0@lo:400:kworker.0 00000100:00100000:0.0:1784045434.523074:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873891456:12345-0@lo:400:kworker.0 Request processed in 3584us (6469us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045434.523086:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1784045434.523193:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873892352:12345-0@lo:400:kworker.0 Request processed in 2802us (6547us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045434.523203:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784045434.523244:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873892992 00000100:00100000:1.0:1784045434.523253:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873892992 00000100:00100000:1.0:1784045434.523307:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1784045434.523316:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873892992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045434.523356:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1784045434.524591:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873892224:0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.524616:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873892736:0@lo:400:kworker.0 00000100:00100000:3.0:1784045434.524694:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873892352:0@lo:400:kworker.0 00000100:00080000:3.0:1784045434.524752:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784045434.524759:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784045434.524763:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045434.524766:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045434.525568:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873892992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045434.525604:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1784045434.527579:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b830f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873892224:12345-0@lo:400:kworker.0 Request processed in 10299us (10754us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045434.527598:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784045434.527748:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873891456:0@lo:400:kworker.0 00000100:00100000:0.0:1784045434.527834:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873892992:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784045434.835742:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045435.027725:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045435.027774:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045435.027803:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873893248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045435.027918:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045435.028514:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873893248 00000100:00100000:2.0:1784045435.028532:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873893248 00000100:00100000:2.0:1784045435.028601:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784045435.028612:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873893248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784045435.028650:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784045435.028711:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873893248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045435.028719:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784045435.029569:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873893248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045435.030596:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873893120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045435.030681:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045435.030939:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873893120 00000100:00100000:3.0:1784045435.030949:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873893120 00000100:00100000:3.0:1784045435.031009:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784045435.031020:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873893120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784045435.031049:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045435.031115:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873893120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045435.031122:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784045435.031266:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873893120:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784045435.860905:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045436.883836:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045437.587727:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873893376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045437.587831:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045437.587929:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873893376 00000100:00100000:2.0:1784045437.587938:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873893376 00000100:00100000:2.0:1784045437.588009:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784045437.588019:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873893376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784045437.588057:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1784045437.588104:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873893376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045437.588119:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784045437.588188:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873893376:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784045437.588223:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045437.590629:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045437.594083:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873893504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045437.594369:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045437.595710:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873893504 00000100:00100000:0.0:1784045437.595727:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873893504 00000100:00100000:0.0:1784045437.595814:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784045437.595826:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873893504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784045437.595865:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784045437.595972:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873893504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045437.595981:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1784045437.596040:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045437.596102:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873893504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784045437.913940:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784045437.968495:0:14986:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:10:35 (1784045435) 00000100:00100000:2.0:1784045438.099709:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873893632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045438.099782:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045438.100182:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873893632 00000100:00100000:1.0:1784045438.100190:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873893632 00000100:00100000:1.0:1784045438.100245:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1784045438.100254:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873893632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784045438.100285:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784045438.100343:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873893632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045438.100351:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1784045438.100848:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873893632:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1784045438.104665:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:1.0:1784045438.104685:0:6475:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1784045438.104758:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1784045438.104771:0:6528:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1784045438.420136:0:13778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1784045438.803688:0:13774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784045438.803695:0:13774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784045438.803898:0:13774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1784045438.803907:0:13774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1784045438.932319:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045439.167581:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045439.167621:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045439.167643:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045439.167670:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045439.167689:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045439.167704:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045439.167733:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045439.167758:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863356416 00000100:00100000:2.0:1784045439.167766:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863356416 00000100:00100000:2.0:1784045439.167814:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863356928 00000100:00100000:2.0:1784045439.167817:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863356928 00000100:00100000:2.0:1784045439.167829:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863356544 00000100:00100000:2.0:1784045439.167832:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863356544 00000100:00100000:2.0:1784045439.167842:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863357056 00000100:00100000:2.0:1784045439.167844:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863357056 00000100:00100000:2.0:1784045439.167858:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 363 00000100:00100000:2.0:1784045439.167882:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:2397:x1870706863356416:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045439.167958:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:2397:x1870706863356416:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 78us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045439.167966:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 363 00000100:00100000:2.0:1784045439.167982:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 364 00000100:00100000:2.0:1784045439.167988:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2397:x1870706863356928:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045439.168011:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2397:x1870706863356928:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 23us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045439.168017:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 364 00000100:00100000:2.0:1784045439.168028:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 365 00000100:00100000:2.0:1784045439.168032:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863356544:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045439.168050:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863356544:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 18us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045439.168055:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 365 00000100:00100000:2.0:1784045439.168077:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 366 00000100:00100000:2.0:1784045439.168083:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863357056:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045439.168104:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2397:x1870706863357056:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 21us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045439.168109:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 366 00000100:00100000:2.0:1784045439.168128:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863356288 00000100:00100000:2.0:1784045439.168131:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863356288 00000100:00100000:2.0:1784045439.168164:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 397 00000100:00100000:2.0:1784045439.168171:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2397:x1870706863356288:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045439.168203:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2397:x1870706863356288:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 33us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045439.168209:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 397 00000100:00080000:2.0:1784045439.168232:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045439.168236:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045439.168317:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863356672 00000100:00100000:3.0:1784045439.168321:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863356672 00000100:00100000:3.0:1784045439.168365:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863356800 00000100:00100000:3.0:1784045439.168368:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863356800 00000100:00100000:3.0:1784045439.168387:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 183 00000100:00100000:3.0:1784045439.168394:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2397:x1870706863356672:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045439.168423:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2397:x1870706863356672:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 29us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045439.168428:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 183 00000100:00100000:3.0:1784045439.168438:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 184 00000100:00100000:3.0:1784045439.168476:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863356800:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045439.168498:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2397:x1870706863356800:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 22us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045439.168502:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 184 00000100:00080000:2.0:1784045439.168602:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045439.168605:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045439.636850:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873893888:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.636922:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045439.636970:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873894400:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.636991:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045439.637009:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873894912:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.637029:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045439.637064:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1784045439.637071:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873893760:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.637096:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045439.637115:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873894272:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.637148:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045439.637163:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873894784:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.637183:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045439.637199:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873895296:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.637217:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045439.637241:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873894016:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.637261:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045439.637276:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873894528:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.637293:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045439.637306:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873895040:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.637325:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045439.637336:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1784045439.637340:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873894144:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.637357:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045439.637366:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873894656:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.637383:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045439.637410:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873895168:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.637434:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045439.637729:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873894272 00000100:00100000:1.0:1784045439.637735:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873894272 00000100:00100000:1.0:1784045439.637770:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873894016 00000100:00100000:1.0:1784045439.637771:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873894016 00000100:00100000:1.0:1784045439.637782:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784045439.637788:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873894272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045439.641213:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873893760 00000100:00100000:3.0:1784045439.641230:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873893760 00000100:00100000:3.0:1784045439.641286:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1784045439.641296:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873893760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045439.642031:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045439.642058:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873895424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045439.642241:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045439.642256:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873893888 00000100:00100000:0.0:1784045439.642264:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873893888 00000100:00100000:0.0:1784045439.642306:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873894400 00000100:00100000:0.0:1784045439.642317:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873894400 00000100:00100000:0.0:1784045439.642344:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873894912 00000100:00100000:0.0:1784045439.642348:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873894912 00000100:00100000:0.0:1784045439.642360:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873894528 00000100:00100000:0.0:1784045439.642362:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873894528 00000100:00100000:0.0:1784045439.642375:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873895040 00000100:00100000:0.0:1784045439.642378:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873895040 00000100:00100000:0.0:1784045439.642392:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873894144 00000100:00100000:0.0:1784045439.642395:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873894144 00000100:00100000:0.0:1784045439.642408:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1784045439.642415:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873893888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.642569:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873893888:12345-0@lo:400:kworker.0 Request processed in 154us (5647us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045439.642578:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1784045439.642595:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1784045439.642601:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873894400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.642631:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873894400:12345-0@lo:400:kworker.0 Request processed in 30us (5638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045439.642636:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1784045439.642647:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1784045439.642653:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873894912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.642680:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873894912:12345-0@lo:400:kworker.0 Request processed in 27us (5651us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045439.642685:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1784045439.642697:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1784045439.642702:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873894528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.642734:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873894528:12345-0@lo:400:kworker.0 Request processed in 32us (5440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045439.642747:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1784045439.642759:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1784045439.642765:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873895040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.642795:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873895040:12345-0@lo:400:kworker.0 Request processed in 31us (5469us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045439.642801:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1784045439.642812:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1784045439.642818:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873894144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.642843:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873894144:12345-0@lo:400:kworker.0 Request processed in 26us (5486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045439.642848:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1784045439.642982:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873894272:12345-0@lo:400:kworker.0 Request processed in 5192us (5843us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045439.643001:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784045439.643024:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873895424 00000100:00100000:1.0:1784045439.643028:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873895424 00000100:00100000:1.0:1784045439.643047:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1784045439.643054:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3623:x1870706873894016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045439.643102:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3623:x1870706873894016:12345-0@lo:400:kworker.0 Request processed in 48us (5839us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045439.643109:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1784045439.643123:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1784045439.643129:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873895424:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045439.643151:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3626:x1870706873893760:12345-0@lo:400:kworker.0 Request processed in 1854us (6051us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045439.643161:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000004:00000024:1.0:1784045439.643166:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1784045439.643213:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873895424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045439.643219:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1784045439.643376:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873895424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045439.643659:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873894784 00000100:00100000:1.0:1784045439.643665:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873894784 00000100:00100000:1.0:1784045439.643697:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873895296 00000100:00100000:1.0:1784045439.643702:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873895296 00000100:00100000:1.0:1784045439.643716:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873894656 00000100:00100000:1.0:1784045439.643719:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873894656 00000100:00100000:1.0:1784045439.643734:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873895168 00000100:00100000:1.0:1784045439.643737:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873895168 00000100:00100000:1.0:1784045439.643753:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784045439.643760:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873894784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045439.643805:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873894784:12345-0@lo:400:kworker.0 Request processed in 45us (6621us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045439.643817:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784045439.643832:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1784045439.643838:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873895296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045439.643868:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873895296:12345-0@lo:400:kworker.0 Request processed in 30us (6649us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045439.643874:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1784045439.643886:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1784045439.643890:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873894656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.643984:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1784045439.643993:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873895168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.644029:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873895168:12345-0@lo:400:kworker.0 Request processed in 37us (6594us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045439.644034:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:0.0:1784045439.644058:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045439.644063:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045439.644065:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784045439.644067:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045439.644087:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873893760:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.644099:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873894272:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.644109:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873894784:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.644119:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873895296:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.644153:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873893888:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.644164:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873894400:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.644174:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873894912:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.644215:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873894144:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.644230:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873895168:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.644239:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873894016:0@lo:400:kworker.0 00000100:00100000:1.0:1784045439.644245:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873894656:12345-0@lo:400:kworker.0 Request processed in 355us (6862us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045439.644251:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00010000:00080000:0.0:1784045439.644253:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c812ace00 x1870706873894528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045439.644263:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873894528:0@lo:400:kworker.0 00010000:00080000:0.0:1784045439.644274:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c812adc00 x1870706873895040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045439.648852:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873895040:0@lo:400:kworker.0 00000100:00100000:0.0:1784045439.648938:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873894656:0@lo:400:kworker.0 00010000:00010000:1.0:1784045439.955771:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045440.147757:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784045440.147781:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873895552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045440.147864:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045440.147994:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873895552 00000100:00100000:0.0:1784045440.148003:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873895552 00000100:00100000:0.0:1784045440.148067:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784045440.148077:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873895552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045440.148106:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045440.148164:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873895552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045440.148172:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1784045440.148461:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873895552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045440.148701:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045440.148712:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873895680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045440.148751:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045440.149145:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873895680 00000100:00100000:3.0:1784045440.149151:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873895680 00000100:00100000:3.0:1784045440.149195:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784045440.149203:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873895680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784045440.149390:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784045440.149465:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873895680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 240us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045440.149473:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784045440.149641:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873895680:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1784045440.985860:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045441.332602:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045441.336321:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863357312 00000100:00100000:3.0:1784045441.336344:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863357312 00000100:00100000:3.0:1784045441.336469:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:3.0:1784045441.336488:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+18:13186:x1870706863357312:12345-192.168.203.44@tcp:35:umount.0 00000100:00100000:3.0:1784045441.336841:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:13186:x1870706863357312:12345-192.168.203.44@tcp:35:umount.0 Request processed in 358us (4252us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1784045441.336850:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00080000:0.0:1784045441.337410:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045441.349281:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045441.349376:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863357568 00000100:00100000:3.0:1784045441.349400:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863357568 00000100:00100000:3.0:1784045441.349498:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:3.0:1784045441.349510:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+19:13186:x1870706863357568:12345-192.168.203.44@tcp:35:umount.0 00000100:00100000:3.0:1784045441.350045:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:13186:x1870706863357568:12345-192.168.203.44@tcp:35:umount.0 Request processed in 534us (785us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1784045441.350055:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:2.0:1784045441.356868:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045441.357021:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863357824 00000100:00100000:3.0:1784045441.357035:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863357824 00000100:00100000:3.0:1784045441.357105:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:3.0:1784045441.357118:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c98559850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+20:13186:x1870706863357824:12345-192.168.203.44@tcp:35:umount.0 00000100:00100000:3.0:1784045441.357425:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c98559850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:13186:x1870706863357824:12345-192.168.203.44@tcp:35:umount.0 Request processed in 309us (570us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1784045441.357434:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:1.0:1784045441.366667:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045441.366815:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863358080 00000100:00100000:3.0:1784045441.366829:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863358080 00000100:00100000:3.0:1784045441.366899:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:3.0:1784045441.366910:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:13186:x1870706863358080:12345-192.168.203.44@tcp:35:umount.0 00000100:00100000:3.0:1784045441.367304:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:13186:x1870706863358080:12345-192.168.203.44@tcp:35:umount.0 Request processed in 394us (650us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1784045441.367312:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:1.0:1784045441.375838:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045441.375880:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045441.375911:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045441.376062:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863358208 00000100:00100000:3.0:1784045441.376075:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863358208 00000100:00100000:3.0:1784045441.376154:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863358336 00000100:00100000:3.0:1784045441.376158:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863358336 00000100:00100000:3.0:1784045441.376173:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863358464 00000100:00100000:3.0:1784045441.376193:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863358464 00000100:00100000:3.0:1784045441.376217:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:3.0:1784045441.376228:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:019b5529-a0fa-4aaf-b296-1845dacd5d85+15:2395:x1870706863358208:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045441.376247:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045441.376272:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106f200/0x5475624df454c660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edc0 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045441.376293:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045441.376360:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:019b5529-a0fa-4aaf-b296-1845dacd5d85+14:2395:x1870706863358208:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 133us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045441.376369:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:3.0:1784045441.376401:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:3.0:1784045441.376408:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:019b5529-a0fa-4aaf-b296-1845dacd5d85+13:2395:x1870706863358336:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045441.376416:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045441.376426:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915aac00/0x5475624df454c5a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ed81 expref: 13 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045441.376435:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045441.376500:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:2395:x1870706863358336:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 91us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045441.376506:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:3.0:1784045441.376519:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:3.0:1784045441.376525:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:2397:x1870706863358464:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045441.376532:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045441.376652:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b836cd200/0x5475624df454c87b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee99 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045441.376671:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045441.376692:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2397:x1870706863358464:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 167us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045441.376699:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:1.0:1784045441.376837:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045441.377498:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863358592 00000100:00100000:0.0:1784045441.377506:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863358592 00000100:00100000:0.0:1784045441.377583:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 80 00000100:00100000:0.0:1784045441.377594:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2393:x1870706863358592:12345-192.168.203.44@tcp:9:umount.0 00000020:00000080:0.0:1784045441.377626:0:8648:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c97e 00000100:00080000:0.0:1784045441.377636:0:8648:0:(import.c:65:import_set_state_nolock()) ffff939b83392800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784045441.377696:0:8648:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1784045441.377896:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+2:2393:x1870706863358592:12345-192.168.203.44@tcp:9:umount.0 Request processed in 304us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045441.377904:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 80 00010000:00010000:0.0:1784045441.377931:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784045441.378598:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045441.382429:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045441.382648:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863358976 00000100:00100000:3.0:1784045441.382660:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863358976 00000100:00100000:3.0:1784045441.382744:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 81 00000100:00100000:3.0:1784045441.382756:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+7:2393:x1870706863358976:12345-192.168.203.44@tcp:9:umount.0 00000020:00000080:3.0:1784045441.382805:0:8412:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454cbf4 00000020:00010000:3.0:1784045441.382816:0:8412:0:(genops.c:1942:obd_stale_export_put()) Put export ffff939b8405f800: total 0 00000100:00080000:3.0:1784045441.382821:0:8412:0:(import.c:65:import_set_state_nolock()) ffff939b8405e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784045441.382877:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1784045441.383091:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2393:x1870706863358976:12345-192.168.203.44@tcp:9:umount.0 Request processed in 336us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045441.383100:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 81 00000100:00080000:1.0:1784045441.383172:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:0.0:1784045441.383360:0:6484:0:(genops.c:1928:obd_stale_export_get()) Get export ffff939b8405f800: total 0 00010000:00010000:0.0:1784045441.383419:0:6484:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff939b8405f800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1784045441.383521:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000143db477/0x5475624df454cfac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f083 expref: 4 pid: 8412 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045441.383560:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abc78778/0x5475624df454d67b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f266 expref: 3 pid: 8648 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045441.383576:0:6484:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff939b8405f800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1784045441.383590:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045441.383592:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045441.383594:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045441.394156:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045441.394612:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863360000 00000100:00100000:0.0:1784045441.394625:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863360000 00000100:00100000:0.0:1784045441.394755:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 258 00000100:00100000:0.0:1784045441.394768:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+22:2393:x1870706863360000:12345-192.168.203.44@tcp:39:umount.0 00000020:00000080:0.0:1784045441.394838:0:10615:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c5b1 00000020:00010000:0.0:1784045441.394859:0:10615:0:(genops.c:1942:obd_stale_export_put()) Put export ffff939cbf4be800: total 0 00000100:00080000:0.0:1784045441.394864:0:10615:0:(import.c:65:import_set_state_nolock()) ffff939cbf4bf800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784045441.394910:0:10615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1784045441.395116:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+21:2393:x1870706863360000:12345-192.168.203.44@tcp:39:umount.0 Request processed in 351us (973us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1784045441.395135:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 258 00000020:00010000:2.0:1784045441.395464:0:6485:0:(genops.c:1928:obd_stale_export_get()) Get export ffff939cbf4be800: total 0 00010000:00010000:2.0:1784045441.395534:0:6485:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff939cbf4be800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1784045441.395576:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:2.0:1784045441.395580:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784045441.395590:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3200/0x5475624df454d031 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f0a6 expref: 20 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045441.395615:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:2.0:1784045441.395618:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045441.395623:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc2171600/0x5475624df454ce8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f036 expref: 19 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045441.395656:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff939b83091400) 00010000:00010000:2.0:1784045441.395659:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045441.395663:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987a00/0x5475624df454c8dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eea7 expref: 18 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045441.395684:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:2.0:1784045441.395687:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045441.395690:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd400/0x5475624df454d63c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f251 expref: 17 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045441.395702:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:2.0:1784045441.395705:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784045441.395709:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cda00/0x5475624df454d666 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f25f expref: 16 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045441.395722:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:2.0:1784045441.395725:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784045441.395729:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd800/0x5475624df454c954 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eec3 expref: 15 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045441.395754:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff939b81924300) 00010000:00010000:2.0:1784045441.395756:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784045441.395760:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b3800/0x5475624df454d31e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f17f expref: 14 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045441.395777:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85200) 00010000:00010000:2.0:1784045441.395787:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045441.395800:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030200/0x5475624df454d015 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f09f expref: 13 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045441.395818:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c813ee300) 00010000:00010000:2.0:1784045441.395820:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045441.395824:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454c8f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73eeae expref: 12 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045441.395840:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:2.0:1784045441.395842:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784045441.395846:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454cf6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f06e expref: 11 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045441.395859:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff939b82a44600) 00010000:00010000:2.0:1784045441.395861:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784045441.395864:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cca00/0x5475624df454cf97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f07c expref: 10 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045441.395880:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff939b81924e00) 00010000:00010000:2.0:1784045441.395882:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784045441.395886:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454cc4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ef9c expref: 9 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045441.395901:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff939b8310cb00) 00010000:00010000:2.0:1784045441.395904:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045441.395907:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c918b2c00/0x5475624df454d55c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f219 expref: 8 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045441.395921:0:6485:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff939cbf4be800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1784045441.395943:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045441.395946:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045441.395948:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045441.408441:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045441.409508:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863360128 00000100:00100000:0.0:1784045441.409523:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863360128 00000100:00100000:0.0:1784045441.409616:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 259 00000100:00100000:0.0:1784045441.409630:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+5:2393:x1870706863360128:12345-192.168.203.44@tcp:39:umount.0 00000020:00000080:0.0:1784045441.409673:0:6497:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c5b8 00000100:00080000:0.0:1784045441.409694:0:6497:0:(import.c:65:import_set_state_nolock()) ffff939cbf4b9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784045441.409733:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1784045441.410014:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784045441.410174:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045441.410901:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbcbf11d-b5f2-42a6-9759-7590eb85aa60+3:2393:x1870706863360128:12345-192.168.203.44@tcp:39:umount.0 Request processed in 1268us (2470us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784045441.410912:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 259 00010000:00010000:0.0:1784045442.003660:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045442.708388:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045442.708421:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873895808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045442.708547:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045442.709609:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873895808 00000100:00100000:1.0:1784045442.709622:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873895808 00000100:00100000:1.0:1784045442.709697:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784045442.709709:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873895808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045442.709749:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1784045442.709844:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873895808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045442.709852:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1784045442.709883:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045442.709938:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873895808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045442.711482:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873895936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045442.711564:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045442.711818:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873895936 00000100:00100000:1.0:1784045442.711826:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873895936 00000100:00100000:1.0:1784045442.711892:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784045442.711902:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873895936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784045442.711931:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:2.0:1784045442.712169:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045442.716989:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873895936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5071us (5408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045442.717010:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784045442.719917:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873895936:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784045443.027821:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045443.220360:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045443.220391:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873896064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045443.220530:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045443.220862:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873896064 00000100:00100000:1.0:1784045443.220871:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873896064 00000100:00100000:1.0:1784045443.220938:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1784045443.220950:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873896064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784045443.221008:0:6501:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1784045443.221079:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873896064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045443.221096:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1784045443.221361:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873896064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784045443.499605:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045443.499661:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045443.499839:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045443.502993:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863360384 00000100:00100000:0.0:1784045443.503014:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863360384 00000100:00100000:0.0:1784045443.503326:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863360512 00000100:00100000:0.0:1784045443.503331:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863360512 00000100:00100000:0.0:1784045443.503352:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863360256 00000100:00100000:0.0:1784045443.503355:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863360256 00000100:00100000:0.0:1784045443.503380:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:0.0:1784045443.503396:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:2396:x1870706863360384:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045443.503419:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784045443.503426:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:2.0:1784045443.503436:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:019b5529-a0fa-4aaf-b296-1845dacd5d85+12:2396:x1870706863360512:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045443.503465:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106e800/0x5475624df454c6bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee06 expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045443.503498:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045443.503574:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:019b5529-a0fa-4aaf-b296-1845dacd5d85+11:2396:x1870706863360384:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 185us (3988us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045443.503583:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:0.0:1784045443.503604:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:0.0:1784045443.503611:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:019b5529-a0fa-4aaf-b296-1845dacd5d85+10:2395:x1870706863360256:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045443.503619:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045443.503642:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc2171c00/0x5475624df454c6b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edd5 expref: 10 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045443.503653:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045443.503672:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:019b5529-a0fa-4aaf-b296-1845dacd5d85+9:2395:x1870706863360256:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 62us (3834us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045443.503697:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 25 00010000:00010000:2.0:1784045443.507391:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045443.507430:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b836cc600/0x5475624df454c874 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73ee92 expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045443.507476:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045443.507562:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:019b5529-a0fa-4aaf-b296-1845dacd5d85+7:2396:x1870706863360512:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 4126us (7898us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045443.507574:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:1.0:1784045443.512048:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045443.512860:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863360768 00000100:00100000:3.0:1784045443.512874:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863360768 00000100:00100000:3.0:1784045443.513003:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 260 00000100:00100000:3.0:1784045443.513016:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+6:2393:x1870706863360768:12345-192.168.203.44@tcp:39:umount.0 00000020:00000080:3.0:1784045443.513068:0:6496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c6c9 00000020:00010000:3.0:1784045443.513077:0:6496:0:(genops.c:1942:obd_stale_export_put()) Put export ffff939cb6870000: total 0 00000100:00080000:3.0:1784045443.513083:0:6496:0:(import.c:65:import_set_state_nolock()) ffff939cb6872800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784045443.513129:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:3.0:1784045443.513344:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2393:x1870706863360768:12345-192.168.203.44@tcp:39:umount.0 Request processed in 330us (1309us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1784045443.513370:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 260 00000020:00010000:3.0:1784045443.513589:0:7904:0:(genops.c:1928:obd_stale_export_get()) Get export ffff939cb6870000: total 0 00010000:00010000:3.0:1784045443.513594:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045443.513656:0:7904:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff939cb6870000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784045443.513702:0:7904:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c93a85200) 00010000:00010000:3.0:1784045443.513706:0:7904:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784045443.513715:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987200/0x5475624df454d689 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f26d expref: 4 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045443.513753:0:7904:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff939cb6870000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1784045443.513766:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045443.513768:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045443.513769:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784045443.515237:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045443.520363:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045443.520499:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863360896 00000100:00100000:3.0:1784045443.520512:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863360896 00000100:00100000:3.0:1784045443.520598:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 261 00000100:00100000:3.0:1784045443.520610:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+5:2393:x1870706863360896:12345-192.168.203.44@tcp:39:umount.0 00000100:00080000:2.0:1784045443.520775:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:3.0:1784045443.520945:0:6498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c6d0 00000100:00080000:3.0:1784045443.520958:0:6498:0:(import.c:65:import_set_state_nolock()) ffff939cb7b89000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784045443.521027:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1784045443.521263:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3b4a878-6779-48a0-8f76-90916f645fbb+3:2393:x1870706863360896:12345-192.168.203.44@tcp:39:umount.0 Request processed in 654us (912us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1784045443.521273:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 261 00010000:00010000:0.0:1784045443.526397:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045443.564003:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045443.564284:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863361152 00000100:00100000:1.0:1784045443.564355:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863361152 00000100:00100000:1.0:1784045443.564426:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 399 00000100:00100000:1.0:1784045443.564438:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+7:2393:x1870706863361152:12345-192.168.203.44@tcp:251:umount.0 00000020:00000080:1.0:1784045443.564529:0:6490:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c58e 00000020:00010000:1.0:1784045443.564541:0:6490:0:(genops.c:1942:obd_stale_export_put()) Put export ffff939cbf47f000: total 0 00000100:00080000:1.0:1784045443.564546:0:6490:0:(import.c:65:import_set_state_nolock()) ffff939cbf47e800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784045443.564682:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:019b5529-a0fa-4aaf-b296-1845dacd5d85+3:2393:x1870706863361152:12345-192.168.203.44@tcp:251:umount.0 Request processed in 244us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045443.564691:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 399 00000020:00010000:2.0:1784045443.564841:0:6485:0:(genops.c:1928:obd_stale_export_get()) Get export ffff939cbf47f000: total 0 00010000:00010000:2.0:1784045443.564913:0:6485:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff939cbf47f000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1784045443.565869:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106ec00/0x5475624df454c667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73edc7 expref: 2 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045443.565892:0:6485:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff939cbf47f000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1784045443.565922:0:6485:0:(genops.c:906:class_export_put()) final put ffff939cbf47f000/019b5529-a0fa-4aaf-b296-1845dacd5d85 00010000:00010000:2.0:1784045443.565946:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045443.565948:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045443.565951:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784045443.566680:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939cbf47f000/019b5529-a0fa-4aaf-b296-1845dacd5d85 for MGS 00000020:00000080:1.0:1784045443.566736:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cbf47e800 for MGS 00010000:00010000:2.0:1784045444.054424:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784045444.759936:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e3b4a878-6779-48a0-8f76-90916f645fbb 00000001:00080000:1.0:1784045444.759958:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:1.0:1784045444.759964:0:6475:0:(genops.c:906:class_export_put()) final put ffff939cb6870000/e3b4a878-6779-48a0-8f76-90916f645fbb 00000001:00100000:1.0:1784045444.759980:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000001:00080000:1.0:1784045444.759988:0:6475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1784045444.759996:0:6475:0:(genops.c:906:class_export_put()) final put ffff939cbf4be800/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000020:00000080:1.0:1784045444.760012:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb6870000/e3b4a878-6779-48a0-8f76-90916f645fbb for lustre-MDT0000 00000020:00000080:1.0:1784045444.760077:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939cbf4be800/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 for lustre-MDT0000 00000020:00000080:1.0:1784045444.760124:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cb6872800 for lustre-MDT0000 00000020:00000080:1.0:1784045444.760129:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cbf4bf800 for lustre-MDT0000 00000100:00100000:0.0:1784045444.762358:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873896192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045444.762491:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.762578:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873896192 00000100:00100000:0.0:1784045444.762588:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873896192 00000100:00100000:0.0:1784045444.762642:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784045444.762651:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873896192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784045444.762695:0:7897:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1784045444.762747:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873896192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045444.762754:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1784045444.762810:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873896192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045444.763138:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873896320:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763175:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.763208:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873896832:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763234:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.763252:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873897344:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763273:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.763291:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784045444.763296:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873896448:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763333:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.763349:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873896960:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763369:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.763385:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873897472:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763407:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.763428:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873896704:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763475:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.763492:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873897216:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763515:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.763531:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873897728:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763550:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.763566:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784045444.763571:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873896576:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763592:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.763602:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873897088:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763620:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.763635:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873897600:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763654:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045444.763680:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873896832 00000100:00100000:0.0:1784045444.763685:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873896832 00000100:00100000:0.0:1784045444.763722:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873897344 00000100:00100000:0.0:1784045444.763725:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873897344 00000100:00100000:0.0:1784045444.763739:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873896448 00000100:00100000:0.0:1784045444.763741:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873896448 00000100:00100000:0.0:1784045444.763750:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873896960 00000100:00100000:0.0:1784045444.763753:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873896960 00000100:00100000:0.0:1784045444.763778:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873897472 00000100:00100000:0.0:1784045444.763781:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873897472 00000100:00100000:0.0:1784045444.763792:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873896576 00000100:00100000:0.0:1784045444.763795:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873896576 00000100:00100000:0.0:1784045444.763807:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1784045444.763813:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873896832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763859:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873896832:12345-0@lo:400:kworker.0 Request processed in 45us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045444.763866:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1784045444.763880:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1784045444.763886:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873897344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763911:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873897344:12345-0@lo:400:kworker.0 Request processed in 26us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045444.763918:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1784045444.763929:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1784045444.763934:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873896448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.763959:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873896448:12345-0@lo:400:kworker.0 Request processed in 25us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045444.763966:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1784045444.763977:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1784045444.763982:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873896960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764008:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873896960:12345-0@lo:400:kworker.0 Request processed in 26us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045444.764014:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1784045444.764025:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1784045444.764030:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873897472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764069:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873897472:12345-0@lo:400:kworker.0 Request processed in 39us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045444.764075:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1784045444.764088:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1784045444.764093:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873896576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764133:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873896576:12345-0@lo:400:kworker.0 Request processed in 40us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045444.764139:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1784045444.764167:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873896704 00000100:00100000:0.0:1784045444.764171:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873896704 00000100:00100000:0.0:1784045444.764195:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784045444.764200:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873896704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764232:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873896704:12345-0@lo:400:kworker.0 Request processed in 31us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045444.764238:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784045444.764258:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873897216 00000100:00100000:0.0:1784045444.764262:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873897216 00000100:00100000:0.0:1784045444.764289:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873897728 00000100:00100000:0.0:1784045444.764291:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873897728 00000100:00100000:0.0:1784045444.764303:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873897088 00000100:00100000:0.0:1784045444.764306:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873897088 00000100:00100000:0.0:1784045444.764316:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873897600 00000100:00100000:0.0:1784045444.764318:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873897600 00000100:00100000:0.0:1784045444.764329:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1784045444.764334:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873897216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764363:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873897216:12345-0@lo:400:kworker.0 Request processed in 29us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045444.764369:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1784045444.764390:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1784045444.764396:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873897728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764424:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873897728:12345-0@lo:400:kworker.0 Request processed in 28us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045444.764429:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1784045444.764440:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1784045444.764470:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873897088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764497:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873897088:12345-0@lo:400:kworker.0 Request processed in 29us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045444.764503:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1784045444.764514:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1784045444.764520:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873897600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764544:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873897600:12345-0@lo:400:kworker.0 Request processed in 24us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045444.764550:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:0.0:1784045444.764575:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784045444.764580:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045444.764582:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784045444.764584:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045444.764614:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873896448:0@lo:400:kworker.0 00010000:00080000:0.0:1784045444.764630:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82a8d500 x1870706873896960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045444.764640:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873896960:0@lo:400:kworker.0 00010000:00080000:0.0:1784045444.764649:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82881f80 x1870706873897472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045444.764669:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873897472:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764683:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873896832:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764692:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873897344:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764738:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873896576:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764747:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873897088:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764756:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873897600:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764764:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873896704:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764773:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873897216:0@lo:400:kworker.0 00000100:00100000:0.0:1784045444.764781:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873897728:0@lo:400:kworker.0 00000100:00100000:3.0:1784045444.765011:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873896320 00000100:00100000:3.0:1784045444.765017:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873896320 00000100:00100000:3.0:1784045444.765060:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1784045444.765075:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873896320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045444.765130:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873896320:12345-0@lo:400:kworker.0 Request processed in 57us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045444.765137:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1784045444.765635:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873896320:0@lo:400:kworker.0 00000020:01000004:3.0:1784045445.054885:0:15182:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1784045445.083186:0:15182:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1784045445.083266:0:15182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045445.083286:0:15182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045445.083294:0:15182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045445.083302:0:15182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045445.083333:0:15182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784045445.083339:0:15182:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1784045445.084670:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045445.084685:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045445.084698:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aa800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:0.0:1784045445.084702:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045445.084712:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045445.084720:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045445.084743:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784045445.084746:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784045445.084749:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784045445.084800:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045445.084807:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784045445.084835:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045445.084844:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915aa800/0x5475624df454c636 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c63d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045445.084858:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045445.084860:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045445.084862:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045445.084885:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873897856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045445.084974:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045445.085061:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873897856 00000100:00100000:0.0:1784045445.085070:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873897856 00000100:00100000:0.0:1784045445.085141:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784045445.085152:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3625:x1870706873897856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045445.085167:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045445.085186:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc2171e00/0x5475624df454c63d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c636 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045445.085200:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045445.085240:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:3625:x1870706873897856:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045445.085255:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784045445.085308:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873897856:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1784045445.085666:0:15182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784045445.085672:0:15182:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784045445.085678:0:15182:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784045445.085698:0:15182:0:(import.c:65:import_set_state_nolock()) ffff939cb59c5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784045445.085724:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1870706873897984:0@lo:39:umount.0 00000100:00100000:3.0:1784045445.085764:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784045445.085887:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045445.087140:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873897984 00000100:00100000:0.0:1784045445.087152:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873897984 00000100:00100000:0.0:1784045445.087216:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784045445.087226:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1870706873897984:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784045445.087264:0:6496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c1b3 00000100:00080000:0.0:1784045445.087274:0:6496:0:(import.c:65:import_set_state_nolock()) ffff939c9775d000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784045445.087395:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3622:x1870706873897984:12345-0@lo:39:umount.0 Request processed in 170us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045445.087402:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1784045445.087413:0:6496:0:(genops.c:906:class_export_put()) final put ffff939cb58c4800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1784045445.087441:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784045445.087472:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb58c4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1784045445.088650:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb59c5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784045445.088668:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1870706873897984:0@lo:39:umount.0 00000100:00080000:1.0:1784045445.088751:0:15182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784045445.088773:0:15182:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784045445.088778:0:15182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784045445.089843:0:15182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.089861:0:15182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.089868:0:15182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.089876:0:15182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.089901:0:15182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045445.089908:0:15182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.089915:0:15182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.089922:0:15182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.089928:0:15182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.089945:0:15182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784045445.089962:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045445.089969:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.089987:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106e000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045445.089992:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090002:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045445.090009:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045445.090015:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784045445.090017:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1784045445.090058:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090065:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045445.090095:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090114:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc106e000/0x5475624df454c644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c64b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090130:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045445.090134:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090140:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045445.090142:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090159:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045445.090166:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045445.090171:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1784045445.090173:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1784045445.090176:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784045445.090202:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090208:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045445.090225:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090232:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81987400/0x5475624df454c548 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c54f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090241:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045445.090243:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045445.090244:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045445.090259:0:15182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090266:0:15182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090273:0:15182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090290:0:15182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090304:0:15182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045445.090311:0:15182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454c104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090318:0:15182:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454c104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090324:0:15182:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454c104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090330:0:15182:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454c104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045445.090341:0:15182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1784045445.090345:0:15182:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1784045445.090353:0:15182:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1784045445.090476:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784045445.090484:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045445.090491:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fc200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1784045445.090494:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045445.090502:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045445.090509:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045445.090514:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784045445.090516:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784045445.090517:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784045445.090535:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045445.090541:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045445.090549:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045445.090556:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc21fc200/0x5475624df454c8ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c8b3 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045445.090570:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045445.090582:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454c104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045445.090587:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e79400 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1784045445.090590:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454c104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045445.090596:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454c104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045445.090602:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454c104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045445.090607:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1784045445.090609:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1784045445.090611:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1784045445.090624:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454c104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045445.090630:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045445.090637:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454c104 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045445.090643:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454c104 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c10b expref: -99 pid: 6473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045445.090654:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045445.090656:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045445.090658:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045445.090680:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873898240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045445.090769:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045445.090837:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045445.090844:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873898368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045445.090867:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045445.090906:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873898240 00000100:00100000:2.0:1784045445.090913:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873898240 00000100:00100000:2.0:1784045445.090971:0:9500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873898368 00000100:00100000:2.0:1784045445.090975:0:9500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873898368 00000100:00100000:2.0:1784045445.090999:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784045445.091007:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+24:3623:x1870706873898240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784045445.091022:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045445.091040:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81987600/0x5475624df454c54f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c548 expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045445.091053:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045445.091087:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+23:3623:x1870706873898240:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045445.091094:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784045445.091124:0:9500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784045445.091130:0:9500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:3623:x1870706873898368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784045445.091137:0:9500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045445.091146:0:9500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81986400/0x5475624df454c8b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c8ac expref: 22 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045445.091154:0:9500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045445.091172:0:9500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:3623:x1870706873898368:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045445.091178:0:9500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784045445.091214:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873898368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045445.091232:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873898240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045445.091784:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873898112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045445.091831:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045445.091862:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045445.091868:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873898496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045445.091889:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045445.091915:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873898112 00000100:00100000:0.0:1784045445.091920:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873898112 00000100:00100000:0.0:1784045445.091954:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873898496 00000100:00100000:0.0:1784045445.091958:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873898496 00000100:00100000:0.0:1784045445.091976:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784045445.091983:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+22:3626:x1870706873898112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045445.091993:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045445.092014:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81987000/0x5475624df454c64b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c644 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045445.092025:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045445.092057:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+21:3626:x1870706873898112:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045445.092064:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784045445.092079:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784045445.092085:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+20:3626:x1870706873898496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045445.092093:0:6482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045445.092115:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c80031a00/0x5475624df454c10b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c104 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045445.092125:0:6482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045445.092147:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:3626:x1870706873898496:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045445.092153:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784045445.092184:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873898496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045445.092192:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873898112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045445.092215:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784045445.092264:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939c9775d000 for lustre-MDT0000 00010000:00010000:1.0:1784045445.093154:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784045445.093173:0:15182:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1784045445.093179:0:15182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1784045445.093186:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784045445.093193:0:15182:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:1.0:1784045445.093202:0:15182:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff939c8fd2b000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784045445.093209:0:15182:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff939c8fd2c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784045445.093214:0:15182:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff939c8fd3d800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784045445.093219:0:15182:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff939cbb2f1800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1784045445.093235:0:15182:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff939c915dcd40) has exports, disconnecting them 00000020:00080000:1.0:1784045445.093241:0:15182:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff939c8fd2b000), last request at 1784045444 00000020:00000080:1.0:1784045445.093250:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c4b5 00000100:00080000:1.0:1784045445.093270:0:15182:0:(import.c:65:import_set_state_nolock()) ffff939c8fd2d800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784045445.093333:0:15182:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff939c8fd2b000): rc 0 00000020:00000080:1.0:1784045445.093336:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c8fd2b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1784045445.093350:0:15182:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff939c8fd2c000), last request at 1784045444 00000020:00000080:1.0:1784045445.093354:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c38f 00000100:00080000:1.0:1784045445.093359:0:15182:0:(import.c:65:import_set_state_nolock()) ffff939c8fd28800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784045445.093479:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939c8fd2b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784045445.093523:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939c8fd2d800 for lustre-MDT0000 00010000:00010000:2.0:1784045445.093589:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784045445.093762:0:15182:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff939c8fd2c000): rc 0 00000020:00000080:1.0:1784045445.093765:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c8fd2c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1784045445.093776:0:15182:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff939c8fd3d800), last request at 1784045203 00000020:00000080:1.0:1784045445.093780:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c28c 00000100:00080000:1.0:1784045445.093785:0:15182:0:(import.c:65:import_set_state_nolock()) ffff939c8fd38000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1784045445.093817:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c8fd2c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1784045445.093864:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939c8fd28800 for lustre-MDT0000 00010000:00010000:0.0:1784045445.093943:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1784045445.094005:0:15182:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff939c8fd3d800): rc 0 00000020:00000080:1.0:1784045445.094008:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c8fd3d800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1784045445.094021:0:15182:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff939cbb2f1800), last request at 1784045203 00000020:00000080:1.0:1784045445.094025:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c254 00000100:00080000:1.0:1784045445.094030:0:15182:0:(import.c:65:import_set_state_nolock()) ffff939c8fd3b000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784045445.094053:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939c8fd3d800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784045445.094089:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939c8fd38000 for lustre-MDT0000 00010000:00010000:2.0:1784045445.094153:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1784045445.094213:0:15182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:1.0:1784045445.094331:0:15182:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff939cbb2f1800): rc 0 00000004:00000080:1.0:1784045445.094338:0:15182:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb20487aebae0 00000100:00080000:1.0:1784045445.094374:0:15182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784045445.094379:0:15182:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1784045445.095434:0:15182:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1784045445.095593:0:15182:0:(import.c:65:import_set_state_nolock()) ffff939cbb3c1800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784045445.095665:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873898624:0@lo:39:umount.0 00000100:00100000:3.0:1784045445.095753:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045445.095837:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873898624 00000100:00100000:0.0:1784045445.095860:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873898624 00000100:00100000:0.0:1784045445.095924:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784045445.095935:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1870706873898624:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784045445.095968:0:6501:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c2e7 00000100:00080000:0.0:1784045445.095977:0:6501:0:(import.c:65:import_set_state_nolock()) ffff939cc10bc800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784045445.096250:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1784045445.096909:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:1.0:1784045445.097165:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045445.097211:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3622:x1870706873898624:12345-0@lo:39:umount.0 Request processed in 1275us (1455us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1784045445.097222:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:3.0:1784045445.097502:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cbb3c1800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784045445.097511:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873898624:0@lo:39:umount.0 00000100:00080000:1.0:1784045445.097738:0:15182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784045445.097756:0:15182:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1784045445.097814:0:15182:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784045445.097878:0:15182:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1784045445.097905:0:15182:0:(import.c:65:import_set_state_nolock()) ffff939b82187800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1784045445.097927:0:15182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784045445.097929:0:15182:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1784045445.097942:0:15182:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784045445.098002:0:15182:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1784045445.098012:0:15182:0:(import.c:65:import_set_state_nolock()) ffff939cbf47b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1784045445.098045:0:15182:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff939c915dcd40) has no exports 00000100:00100000:2.0:1784045445.098202:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873898752:0@lo:9:umount.0 00000100:00100000:2.0:1784045445.098265:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045445.098302:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873898880:0@lo:9:umount.0 00000100:00100000:2.0:1784045445.098326:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045445.098481:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873898752 00000100:00100000:0.0:1784045445.098489:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873898752 00000100:00100000:0.0:1784045445.098538:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873898880 00000100:00100000:0.0:1784045445.098542:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873898880 00000100:00100000:0.0:1784045445.098566:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784045445.098574:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1870706873898752:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784045445.098603:0:9935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c445 00000100:00080000:0.0:1784045445.098611:0:9935:0:(import.c:65:import_set_state_nolock()) ffff939b8198a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784045445.098665:0:9935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1784045445.098809:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3622:x1870706873898752:12345-0@lo:9:umount.0 Request processed in 236us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045445.098817:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784045445.098834:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784045445.098839:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3622:x1870706873898880:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784045445.098851:0:9935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c579 00000100:00080000:0.0:1784045445.098857:0:9935:0:(import.c:65:import_set_state_nolock()) ffff939cbf4bd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784045445.098879:0:9935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1784045445.098950:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3622:x1870706873898880:12345-0@lo:9:umount.0 Request processed in 111us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045445.098971:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:2.0:1784045445.099060:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784045445.099087:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b82187800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784045445.099818:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784045445.099823:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784045445.099829:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873898752:0@lo:9:umount.0 00000100:00080000:2.0:1784045445.099854:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cbf47b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784045445.099868:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784045445.099870:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784045445.099873:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873898880:0@lo:9:umount.0 00010000:00010000:2.0:1784045445.099903:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784045445.108799:0:15182:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff939c915dcd40) has no exports 00000020:00000080:3.0:1784045445.176045:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c15f 00000020:00000080:3.0:1784045445.176221:0:15182:0:(genops.c:906:class_export_put()) final put ffff939cb5906000/lustre-QMT0000_UUID 00000020:01000000:3.0:1784045445.176246:0:15182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1784045445.177338:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb5906000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784045445.181183:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784045445.181201:0:15182:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784045445.181206:0:15182:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff939cb58b3380) has no exports 00000020:00000080:2.0:1784045445.181726:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c158 00000020:00000080:2.0:1784045445.181735:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c93989800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784045445.181797:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784045445.181805:0:15182:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784045445.181807:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c9157a800/lustre-QMT0000_UUID 00000020:00000080:2.0:1784045445.181810:0:15182:0:(genops.c:865:class_export_destroy()) destroying export ffff939c9157a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1784045445.181818:0:15182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1784045445.181991:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c93989800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1784045445.271641:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873899008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045445.271748:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045445.272007:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873899008 00000100:00100000:1.0:1784045445.272017:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873899008 00000100:00100000:1.0:1784045445.272109:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784045445.272120:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873899008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784045445.272161:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045445.272275:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873899008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 157us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045445.272284:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1784045445.275236:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873899008:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784045446.100556:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784045446.807628:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784045446.807645:0:8407:0:(genops.c:906:class_export_put()) final put ffff939b81988000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784045446.807675:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000020:00000080:3.0:1784045446.807680:0:8407:0:(genops.c:906:class_export_put()) final put ffff939b8405f800/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000020:00000080:1.0:1784045446.807826:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939b81988000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1784045446.807901:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939b8405f800/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 for lustre-OST0000 00000020:00000080:1.0:1784045446.807934:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b8198a800 for lustre-OST0000 00000020:00000080:1.0:1784045446.807955:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b8405e800 for lustre-OST0000 00000001:00100000:3.0:1784045446.816284:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784045446.816301:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1784045446.816306:0:7428:0:(genops.c:906:class_export_put()) final put ffff939cbb2f2000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784045446.816331:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e3b4a878-6779-48a0-8f76-90916f645fbb 00000001:00080000:3.0:1784045446.816338:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1784045446.816340:0:7428:0:(genops.c:906:class_export_put()) final put ffff939cb7b8e000/e3b4a878-6779-48a0-8f76-90916f645fbb 00000001:00100000:3.0:1784045446.816346:0:7428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000001:00080000:3.0:1784045446.816359:0:7428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1784045446.816361:0:7428:0:(genops.c:906:class_export_put()) final put ffff939cbf4bc000/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000020:00000080:0.0:1784045446.816534:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cbb2f2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1784045446.816588:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb7b8e000/e3b4a878-6779-48a0-8f76-90916f645fbb for lustre-MDT0001 00000020:00000080:0.0:1784045446.816608:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cbf4bc000/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 for lustre-MDT0001 00000020:00000080:0.0:1784045446.816629:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cc10bc800 for lustre-MDT0001 00000020:00000080:0.0:1784045446.816633:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cb7b89000 for lustre-MDT0001 00000020:00000080:0.0:1784045446.816637:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cbf4b9000 for lustre-MDT0001 00000001:00100000:1.0:1784045446.816935:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784045446.816939:0:9491:0:(genops.c:906:class_export_put()) final put ffff939cbf4b8000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1784045446.816960:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000020:00000080:1.0:1784045446.816978:0:9491:0:(genops.c:906:class_export_put()) final put ffff939b83394000/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 00000020:00000080:3.0:1784045446.817032:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939cbf4b8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1784045446.817066:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939b83394000/bbcbf11d-b5f2-42a6-9759-7590eb85aa60 for lustre-OST0001 00000020:00000080:3.0:1784045446.817080:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cbf4bd800 for lustre-OST0001 00000020:00000080:3.0:1784045446.817083:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b83392800 for lustre-OST0001 00010000:00010000:2.0:1784045447.123661:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045447.828271:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873899136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045447.828349:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045447.828481:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873899136 00000100:00100000:0.0:1784045447.828490:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873899136 00000100:00100000:0.0:1784045447.828551:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784045447.828561:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873899136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784045447.828588:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784045447.828636:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873899136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045447.828644:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:2.0:1784045447.828804:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045447.828843:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873899136:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784045448.147669:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784045448.660903:0:13778:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784045449.172843:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045449.875755:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873899392:0@lo:400:kworker.0 00000100:00100000:1.0:1784045449.875792:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873899264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045449.876868:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873899520:0@lo:400:kworker.0 00000100:00100000:1.0:1784045449.877871:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045449.877895:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873899648:0@lo:400:kworker.0 00000100:00100000:1.0:1784045449.878003:0:7897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873899264 00000100:00100000:1.0:1784045449.878011:0:7897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873899264 00000100:00100000:1.0:1784045449.878055:0:7897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1784045449.878063:0:7897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3624:x1870706873899264:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1784045449.878081:0:7897:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784045449.878127:0:7897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3624:x1870706873899264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (257us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784045449.878134:0:7897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:02020000:1.0:1784045449.878265:0:3624:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1784045449.884135:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045449.884224:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873899520 00000100:00100000:0.0:1784045449.884233:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873899520 00000100:00100000:0.0:1784045449.884276:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1784045449.884284:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1870706873899520:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784045449.884292:0:6502:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784045449.885194:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3626:x1870706873899520:12345-0@lo:400:kworker.0 Request processed in 907us (1063us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784045449.885203:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:0.0:1784045449.885260:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784045449.885266:0:3626:0:(import.c:65:import_set_state_nolock()) ffff939cb59c7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784045449.885270:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1784045449.885512:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045449.885585:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873899392 00000100:00100000:3.0:1784045449.885592:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873899392 00000100:00100000:3.0:1784045449.885627:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1784045449.885635:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c97791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:3625:x1870706873899392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045449.885701:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c97791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e855152-ca69-43a0-b465-3bf4e35d62f0+19:3625:x1870706873899392:12345-0@lo:400:kworker.0 Request processed in 67us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045449.885707:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1784045449.885762:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:3625:1870706873899392:0@lo:400:kworker.0 00000100:00100000:3.0:1784045449.885841:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873899904:0@lo:400:kworker.0 00000100:00100000:3.0:1784045449.885871:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045449.885911:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045449.885916:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873900032:0@lo:400:kworker.0 00000100:00100000:3.0:1784045449.885941:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045449.885988:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873900416:0@lo:400:kworker.0 00000100:00100000:3.0:1784045449.886015:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045449.886189:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873900032 00000100:00100000:3.0:1784045449.886194:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873900032 00000100:00100000:3.0:1784045449.886228:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873900416 00000100:00100000:3.0:1784045449.886231:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873900416 00000100:00100000:3.0:1784045449.886252:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1784045449.886258:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873900032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045449.886297:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873900032:12345-0@lo:400:kworker.0 Request processed in 40us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045449.886303:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1784045449.886313:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1784045449.886332:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873900416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045449.886361:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873900416:12345-0@lo:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045449.886366:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1784045449.886559:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873899904 00000100:00100000:3.0:1784045449.886563:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873899904 00000100:00100000:3.0:1784045449.886593:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1784045449.886599:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873899904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045449.886631:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873899904:12345-0@lo:400:kworker.0 Request processed in 32us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045449.886637:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1784045449.886670:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873900416:0@lo:400:kworker.0 00000100:00100000:3.0:1784045449.886681:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873900032:0@lo:400:kworker.0 00010000:00080000:3.0:1784045449.886692:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82882300 x1870706873899904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045449.886702:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873899904:0@lo:400:kworker.0 00000100:00080000:3.0:1784045449.886732:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784045449.886737:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784045449.886739:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045449.888777:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045449.888860:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873900160:0@lo:400:kworker.0 00000100:00100000:2.0:1784045449.888972:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045449.889000:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784045449.889007:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873899776:0@lo:400:kworker.0 00000100:00100000:2.0:1784045449.889031:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045449.889048:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873900288:0@lo:400:kworker.0 00000100:00100000:2.0:1784045449.889066:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045449.889119:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873899648 00000100:00100000:2.0:1784045449.889126:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873899648 00000100:00100000:2.0:1784045449.889155:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873900160 00000100:00100000:2.0:1784045449.889158:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873900160 00000100:00100000:2.0:1784045449.889166:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873899776 00000100:00100000:2.0:1784045449.889169:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873899776 00000100:00100000:2.0:1784045449.889175:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873900288 00000100:00100000:2.0:1784045449.889177:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873900288 00000100:00100000:3.0:1784045449.889328:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1784045449.889336:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1870706873899648:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784045449.889344:0:6496:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784045449.889388:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1870706873899648:12345-0@lo:400:kworker.0 Request processed in 52us (619us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784045449.889395:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1784045449.889428:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1784045449.889432:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1870706873900160:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784045449.889436:0:6496:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784045449.889482:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1870706873900160:12345-0@lo:400:kworker.0 Request processed in 48us (511us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784045449.889487:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1784045449.889499:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1784045449.889502:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1870706873899776:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784045449.889507:0:6496:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784045449.889528:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3623:x1870706873899776:12345-0@lo:400:kworker.0 Request processed in 24us (495us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784045449.889533:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1784045449.889595:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784045449.889599:0:3623:0:(import.c:65:import_set_state_nolock()) ffff939b81989000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784045449.889608:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784045449.889613:0:3623:0:(import.c:65:import_set_state_nolock()) ffff939b81989000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045449.889617:0:3623:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 179 00000100:00100000:2.0:1784045449.889945:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1784045449.889952:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873900288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045449.889993:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873900288:12345-0@lo:400:kworker.0 Request processed in 42us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045449.890010:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00080000:2.0:1784045449.890028:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784045449.890181:0:3623:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff939b81989000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045449.890210:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82882300 x1870706873900544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784045449.890232:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873899776:0@lo:400:kworker.0 00010000:00080000:3.0:1784045449.890249:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82880e00 x1870706873900288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045449.890260:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873900288:0@lo:400:kworker.0 00000100:00080000:3.0:1784045449.890269:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784045449.890279:0:3623:0:(import.c:65:import_set_state_nolock()) ffff939b82a1c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784045449.890282:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784045449.890285:0:3623:0:(import.c:65:import_set_state_nolock()) ffff939b82a1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045449.890288:0:3623:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 198 00000100:00080000:3.0:1784045449.890292:0:3623:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff939b82a1c000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045449.890305:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82883100 x1870706873900672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784045449.890315:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873900160:0@lo:400:kworker.0 00000100:00080000:3.0:1784045449.890329:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784045449.890331:0:3623:0:(import.c:65:import_set_state_nolock()) ffff939cb5906800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784045449.890334:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784045449.890337:0:3623:0:(import.c:65:import_set_state_nolock()) ffff939cb5906800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045449.890341:0:3623:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 159 00000100:00080000:3.0:1784045449.890344:0:3623:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff939cb5906800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045449.890355:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82880000 x1870706873900800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784045449.890363:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873899648:0@lo:400:kworker.0 00000100:00100000:3.0:1784045449.893675:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1870706873900544:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784045449.894220:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045449.894513:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1870706873900672:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784045449.894544:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784045449.895220:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1784045449.897215:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1870706873900800:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784045449.897295:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045449.901857:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873900544 00000100:00100000:2.0:1784045449.901873:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873900544 00000100:00100000:2.0:1784045449.901949:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873900672 00000100:00100000:2.0:1784045449.901953:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873900672 00000100:00100000:2.0:1784045449.901976:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1784045449.901986:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1870706873900544:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1784045449.902005:0:6498:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784045449.902057:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873900800 00000100:00100000:3.0:1784045449.902062:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873900800 00000100:00100000:3.0:1784045449.902095:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784045449.902100:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1870706873900672:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1784045449.902109:0:10615:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784045449.902317:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1870706873900672:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 213us (7770us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784045449.902324:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1784045449.902343:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1784045449.902347:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1870706873900800:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1784045449.902355:0:10615:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1784045449.902384:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3622:x1870706873900800:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 34us (5088us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784045449.902390:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1784045449.902425:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b82a1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045449.902430:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784045449.902434:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1870706873900672:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1784045449.902693:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb5906800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045449.902697:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784045449.902700:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1870706873900800:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784045449.926712:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1870706873900544:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 24721us (32487us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784045449.926726:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1784045449.926798:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b81989000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045449.926805:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784045449.926809:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1870706873900544:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1784045449.952347:0:3624:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff939cb59c7000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:0.0:1784045449.953140:0:3626:0:(import.c:65:import_set_state_nolock()) ffff939cb59c7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784045449.953150:0:3626:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 159 00000100:00080000:0.0:1784045449.953160:0:3626:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff939cb59c7000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045449.953354:0:3626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b83380000 x1870706873900928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784045449.953395:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873899520:0@lo:400:kworker.0 00000100:00100000:0.0:1784045449.953618:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873900928:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1784045449.953741:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045449.953789:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873900928 00000100:00100000:0.0:1784045449.953797:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873900928 00000100:00100000:0.0:1784045449.953849:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1784045449.953857:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1870706873900928:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1784045449.953873:0:6502:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1784045449.953928:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1870706873900928:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 71us (187us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784045449.953936:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:3.0:1784045449.954306:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb59c7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045449.954326:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784045449.954566:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83380000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873900928:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:2.0:1784045450.199323:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045450.387900:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045450.387935:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873901056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784045450.388003:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045450.388052:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873901056 00000100:00100000:1.0:1784045450.388060:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873901056 00000100:00100000:1.0:1784045450.388135:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1784045450.388145:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873901056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784045450.388177:0:8416:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784045450.388227:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873901056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045450.388235:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784045450.388283:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873901056:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1784045450.904473:0:6475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784045450.904487:0:6475:0:(genops.c:906:class_export_put()) final put ffff939cbb2f1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784045450.904567:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cbb2f1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1784045450.904651:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939c8fd3b000 for lustre-MDT0000 00000020:01000000:2.0:1784045451.219620:0:15182:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff939b81940720 - data ffff939b81c46af8/ffff939cc139cc00 00000020:01000000:2.0:1784045451.219750:0:15182:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff939c9fda6ba0 - data ffff939caf0b61b0/ffff939cb5b01c00 00010000:00010000:3.0:1784045451.222470:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1784045451.230819:0:15182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:2.0:1784045451.316237:0:15182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784045451.316248:0:15182:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1784045451.316268:0:15182:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff939b82378380 x1870706873898624/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784045455 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045451.316383:0:15182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784045451.322337:0:15182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784045451.322346:0:15182:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1784045451.322358:0:15182:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784045451.322360:0:15182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784045451.323087:0:8646:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784045451.323094:0:8646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1784045451.323107:0:8646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1784045451.324584:0:15182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784045451.324593:0:15182:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1784045451.324616:0:15182:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784045451.324618:0:15182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784045451.324994:0:9933:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784045451.325000:0:9933:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1784045451.325012:0:9933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1784045451.327320:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c127 00000020:00000080:2.0:1784045451.327335:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c93a72000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784045451.328652:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c93a72000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784045451.335962:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c13c 00000020:00000080:2.0:1784045451.335981:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c915ed000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784045451.336037:0:15182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1784045451.336043:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784045451.336054:0:15182:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784045451.336059:0:15182:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff939c915d3380) has no exports 00000004:01000000:2.0:1784045451.336280:0:15182:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1784045451.336291:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c572 00000020:00000080:2.0:1784045451.336296:0:15182:0:(genops.c:906:class_export_put()) final put ffff939cbf4ba800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784045451.343095:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c915ed000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784045451.343569:0:15182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784045451.344086:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939cbf4ba800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784045451.344121:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784045451.344141:0:15182:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784045451.344146:0:15182:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff939c9fddb380) has no exports 00000020:00000080:0.0:1784045451.344159:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c56b 00000020:00000080:0.0:1784045451.344171:0:15182:0:(genops.c:906:class_export_put()) final put ffff939cbf47a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784045451.344360:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939cbf47a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784045451.345888:0:15182:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784045451.345896:0:15182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784045451.345901:0:15182:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1784045451.345909:0:15182:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784045451.345923:0:15182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784045451.345972:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045451.345991:0:15182:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784045451.345998:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cbf47b800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784045451.346002:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c430 00000020:00000080:3.0:1784045451.346008:0:38:0:(genops.c:906:class_export_put()) final put ffff939b82303800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784045451.346009:0:15182:0:(genops.c:906:class_export_put()) final put ffff939b82302000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784045451.346011:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82303800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1784045451.346016:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784045451.346024:0:15182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784045451.346029:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784045451.346034:0:15182:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784045451.346038:0:15182:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff939cb59d0000) has no exports 00000020:00000080:0.0:1784045451.346044:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c429 00000020:00000080:0.0:1784045451.346049:0:15182:0:(genops.c:906:class_export_put()) final put ffff939b82187000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784045451.346231:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82302000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784045451.346236:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82187000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784045451.347516:0:15182:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784045451.347525:0:15182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784045451.347529:0:15182:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1784045451.347538:0:15182:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784045451.347540:0:15182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784045451.347623:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045451.347634:0:15182:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1784045451.347655:0:15182:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784045451.347663:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c2e0 00000020:00000080:0.0:1784045451.347672:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c98520800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784045451.350399:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b82187800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784045451.350426:0:38:0:(genops.c:906:class_export_put()) final put ffff939b82340800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784045451.350430:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82340800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1784045451.350439:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784045451.354880:0:15182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1784045451.354900:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784045451.354916:0:15182:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784045451.354922:0:15182:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff939c9fdd8000) has no exports 00000020:00000080:0.0:1784045451.354934:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c2d9 00000020:00000080:0.0:1784045451.354944:0:15182:0:(genops.c:906:class_export_put()) final put ffff939cbb3c2000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784045451.355084:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c98520800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784045451.360251:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939cbb3c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784045451.422996:0:15182:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1784045451.423008:0:15182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784045451.423013:0:15182:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1784045451.423025:0:15182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784045451.423089:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cbb3c1800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784045451.423100:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045451.423132:0:15182:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784045451.423138:0:15182:0:(genops.c:906:class_export_put()) final put ffff939cbb3c3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784045451.423143:0:15182:0:(genops.c:865:class_export_destroy()) destroying export ffff939cbb3c3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1784045451.423155:0:15182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784045451.423304:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045451.423308:0:15182:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784045451.423312:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c98522800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784045451.423326:0:15182:0:(genops.c:865:class_export_destroy()) destroying export ffff939c98522800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1784045451.423330:0:15182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784045451.423388:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c143 00000020:00000080:0.0:1784045451.423397:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c915e9800/lustre-MDD0000_UUID 00000020:01000000:0.0:1784045451.423413:0:15182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1784045451.423418:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784045451.423424:0:15182:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784045451.423428:0:15182:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff939c915db380) has no exports 00000020:00000080:0.0:1784045451.423476:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045451.423480:0:15182:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1784045451.423485:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c14a 00000020:00000080:0.0:1784045451.423489:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c915e9000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784045451.423499:0:15182:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939c9775c000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1784045451.423502:0:15182:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939c9775c000 3 00000020:01000004:0.0:1784045451.423506:0:15182:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff939c9775c000 from lustre-MDT0000 00000020:00000080:0.0:1784045451.423535:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045451.423539:0:15182:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1784045451.423542:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c98520000/lustre-MDT0000_UUID 00000020:00000080:0.0:1784045451.423544:0:15182:0:(genops.c:865:class_export_destroy()) destroying export ffff939c98520000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1784045451.423554:0:15182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1784045451.423587:0:15182:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1784045451.423591:0:15182:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1784045451.423721:0:15182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1784045451.423725:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784045451.423728:0:15182:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784045451.423741:0:15182:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff939c937bf800 0e855152-ca69-43a0-b465-3bf4e35d62f0 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784045451.423747:0:15182:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff939c901d4d40) has exports, disconnecting them 00000020:00080000:0.0:1784045451.423752:0:15182:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff939c937bf800), last request at 1784045184 00000020:00000080:0.0:1784045451.423769:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c0e8 00000020:00010000:0.0:1784045451.423773:0:15182:0:(genops.c:1942:obd_stale_export_put()) Put export ffff939c937bf800: total 2 00000100:00080000:0.0:1784045451.423778:0:15182:0:(import.c:65:import_set_state_nolock()) ffff939c937bc000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784045451.423795:0:15182:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff939c937bf800): rc 0 00000020:00080000:0.0:1784045451.423800:0:15182:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff939c901d4d40) has no exports 00000100:00100000:0.0:1784045451.423869:0:6488:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff939c92d86c00:6488] 0 exiting: rc = 1 00000020:00010000:2.0:1784045451.424115:0:7904:0:(genops.c:1928:obd_stale_export_get()) Get export ffff939c937bf800: total 2 00010000:00010000:2.0:1784045451.424183:0:7904:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff939c937bf800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1784045451.424225:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106f400/0x5475624df454c613 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c60c expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.424244:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915aa200/0x5475624df454c621 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c61a expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.424258:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915ab800/0x5475624df454c62f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c628 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.424291:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c93e79a00/0x5475624df454c1e4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c1dd expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.424309:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc21fd400/0x5475624df454c1f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c1eb expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.424335:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b836ccc00/0x5475624df454c889 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c882 expref: 9 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.424345:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106fa00/0x5475624df454c659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c652 expref: 8 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.424355:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106fe00/0x5475624df454c5e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c5e2 expref: 7 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.424364:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c915ab600/0x5475624df454c897 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c890 expref: 6 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.424374:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81987c00/0x5475624df454c8a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c89e expref: 5 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.424387:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106f600/0x5475624df454c605 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c5fe expref: 4 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.424398:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106f000/0x5475624df454c5f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c5f0 expref: 3 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.424411:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106e200/0x5475624df454c509 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5475624df454c502 expref: 2 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045451.424436:0:7904:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff939c937bf800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1784045451.424473:0:7904:0:(genops.c:906:class_export_put()) final put ffff939c937bf800/0e855152-ca69-43a0-b465-3bf4e35d62f0 00010000:00010000:2.0:1784045451.424481:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045451.424484:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045451.424486:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045451.424822:0:6490:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff939c99937000:6490] 2 exiting: rc = 0 00000100:00100000:3.0:1784045451.424909:0:6489:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff939cb0cc4a00:6489] 1 exiting: rc = 0 00000020:00000080:3.0:1784045451.424958:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c915e9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1784045451.424964:0:38:0:(genops.c:906:class_export_put()) final put ffff939c915ec000/lustre-MDD0000_UUID 00000020:00000080:3.0:1784045451.424966:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c915ec000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1784045451.424970:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:0.0:1784045451.424978:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.424987:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.424998:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425005:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425011:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425018:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425023:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425029:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784045451.425032:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c915e9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1784045451.425035:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784045451.425036:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c937bf800/0e855152-ca69-43a0-b465-3bf4e35d62f0 for MGS 00000100:00100000:0.0:1784045451.425041:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425048:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425055:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784045451.425082:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939c937bc000 for MGS 00000100:00100000:0.0:1784045451.425109:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425116:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425121:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425128:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425134:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425141:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425147:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425153:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425158:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425164:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425170:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425175:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425191:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425198:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425205:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425211:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425217:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425222:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425228:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425234:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425240:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425247:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425252:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425258:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425263:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425269:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425275:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425281:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425287:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425293:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425299:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425304:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425310:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425382:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425389:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425394:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425400:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425405:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425410:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425416:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425421:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425426:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425431:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425436:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425441:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425507:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425513:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425527:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425531:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425537:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425543:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045451.425549:0:15182:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1784045451.426929:0:15182:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff939c91bf9c60 - data ffff939caf30fbd0/ffff939cc1366400 00000020:01000000:0.0:1784045451.427028:0:15182:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff939c9fda6900 - data ffff939caf0d8870/ffff939c907f6800 00000020:00000080:0.0:1784045451.427557:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c0cc 00000020:00000080:0.0:1784045451.427568:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c9775a000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784045451.427584:0:15182:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939c9775c000 from MGS, refs=2 00000020:01000004:0.0:1784045451.427589:0:15182:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939c9775c000 2 00000020:01000004:0.0:1784045451.427593:0:15182:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff939c9775c000 from MGS 00000020:00000080:0.0:1784045451.427743:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045451.427752:0:15182:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1784045451.427756:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c9775b800/MGS 00000020:00000080:0.0:1784045451.427760:0:15182:0:(genops.c:865:class_export_destroy()) destroying export ffff939c9775b800/MGS for MGS 00000020:01000000:0.0:1784045451.427766:0:15182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1784045451.427843:0:15182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1784045451.427847:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784045451.427853:0:15182:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784045451.427860:0:15182:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff939cb59c2800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784045451.427867:0:15182:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff939cb59d4d40) has exports, disconnecting them 00000020:00080000:0.0:1784045451.427871:0:15182:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff939cb59c2800), last request at 1784045184 00000020:00000080:0.0:1784045451.427876:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c197 00000020:00080000:0.0:1784045451.427883:0:15182:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff939cb59c2800): rc 0 00000020:00000080:0.0:1784045451.427887:0:15182:0:(genops.c:906:class_export_put()) final put ffff939cb59c2800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1784045451.428687:0:15182:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1784045451.428693:0:15182:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784045451.428699:0:15182:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784045451.428706:0:15182:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784045451.428828:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045451.428847:0:15182:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784045451.428854:0:15182:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939c9775c000 1 00000020:00000080:0.0:1784045451.428859:0:15182:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c0be 00000020:00000080:0.0:1784045451.428864:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c97758800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1784045451.428869:0:15182:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784045451.428874:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784045451.428877:0:15182:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784045451.428880:0:15182:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff939c901d0000) has no exports 00000020:00000080:3.0:1784045451.431547:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c9775a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784045451.431564:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb59c2800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784045451.431571:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cb59c5800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784045451.431580:0:38:0:(genops.c:906:class_export_put()) final put ffff939c83c93000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1784045451.431593:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c83c93000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1784045451.431599:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1784045451.431712:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c97758800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784045451.528484:0:15182:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045451.528504:0:15182:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1784045451.528511:0:15182:0:(genops.c:906:class_export_put()) final put ffff939c9775f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784045451.528517:0:15182:0:(genops.c:865:class_export_destroy()) destroying export ffff939c9775f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1784045451.528532:0:15182:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1784045451.528694:0:15182:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff939c9775f000 00000020:02000400:0.0:1784045451.528771:0:15182:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1784045452.243627:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045452.949131:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045452.949160:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873901184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045452.949258:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045452.949341:0:9537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873901184 00000100:00100000:0.0:1784045452.949352:0:9537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873901184 00000100:00100000:0.0:1784045452.949431:0:9537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784045452.949464:0:9537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873901184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784045452.949503:0:9537:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1784045452.949553:0:9537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873901184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045452.949579:0:9537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1784045452.949605:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045452.949653:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873901184:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784045453.269295:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045454.291837:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784045454.999370:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784045454.999386:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784045454.999389:0:37:0:(import.c:65:import_set_state_nolock()) ffff939cb59c7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784045454.999396:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 406 00000100:00080000:1.0:1784045454.999402:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784045454.999409:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff939cb59c7000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1784045454.999435:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82378380 x1870706873901440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784045455.000873:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784045455.000877:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784045455.000881:0:37:0:(import.c:65:import_set_state_nolock()) ffff939cb5906800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784045455.000886:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 405 00000100:00080000:1.0:1784045455.000891:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784045455.000897:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff939cb5906800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1784045455.000923:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b8237a300 x1870706873901568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784045455.000933:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784045455.000936:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784045455.000938:0:37:0:(import.c:65:import_set_state_nolock()) ffff939b81989000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784045455.000941:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 405 00000100:00080000:1.0:1784045455.000943:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784045455.000946:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff939b81989000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1784045455.000958:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82379500 x1870706873901696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784045455.000989:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784045455.000998:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784045455.001000:0:37:0:(import.c:65:import_set_state_nolock()) ffff939b82a1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784045455.001004:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 405 00000100:00080000:1.0:1784045455.001007:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784045455.001011:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff939b82a1c000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1784045455.001023:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82378e00 x1870706873902080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784045455.001075:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873902208:0@lo:400:kworker.0 00000100:00100000:1.0:1784045455.001142:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045455.001200:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784045455.001207:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873901312:0@lo:400:kworker.0 00000400:00000100:1.0:1784045455.001229:0:3623:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870706873901312 offset 0 length 224: 4 00000100:00100000:1.0:1784045455.001247:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873902336:0@lo:400:kworker.0 00000100:00100000:1.0:1784045455.001272:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045455.001302:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873902208 00000100:00100000:1.0:1784045455.001310:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873902208 00000100:00100000:1.0:1784045455.001362:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1784045455.001371:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873902208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045455.001420:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1870706873902208:12345-0@lo:400:kworker.0 Request processed in 49us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045455.001427:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00080000:1.0:1784045455.001478:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1784045455.001506:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff939b8237b480 x1870706873902208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045455.001518:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873902208:0@lo:400:kworker.0 00000100:00100000:2.0:1784045455.004269:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873901440:0@lo:38:kworker.0 00000100:00100000:2.0:1784045455.004342:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045455.004381:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1870706873901568:0@lo:38:kworker.0 00000100:00100000:2.0:1784045455.004409:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045455.004431:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1870706873901696:0@lo:38:kworker.0 00000100:00100000:2.0:1784045455.004473:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045455.004493:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1870706873902080:0@lo:38:kworker.0 00000100:00100000:2.0:1784045455.004516:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045455.004555:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873901824:0@lo:400:kworker.0 00000100:00100000:2.0:1784045455.004579:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045455.004602:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045455.004609:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873901952:0@lo:400:kworker.0 00000100:00100000:2.0:1784045455.004638:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045455.004674:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873902336 00000100:00100000:2.0:1784045455.004682:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873902336 00000100:00100000:2.0:1784045455.010228:0:8648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873901952 00000100:00100000:2.0:1784045455.010240:0:8648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873901952 00000100:00100000:2.0:1784045455.010278:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1784045455.010302:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873902336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045455.010400:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873902336:12345-0@lo:400:kworker.0 Request processed in 102us (9126us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045455.010408:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1784045455.010426:0:8648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1784045455.010434:0:8648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873901952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045455.010491:0:8648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873901952:12345-0@lo:400:kworker.0 Request processed in 58us (5852us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045455.010498:0:8648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1784045455.010524:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873901440 00000100:00100000:2.0:1784045455.010529:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873901440 00000100:00100000:2.0:1784045455.010550:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784045455.010555:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1870706873901440:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784045455.010575:0:6501:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784045455.010809:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873902336:0@lo:400:kworker.0 00000100:00100000:2.0:1784045455.011688:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1870706873901440:12345-0@lo:38:kworker.0 Request processed in 1128us (7343us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784045455.011697:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784045455.011829:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873901568 00000100:00100000:2.0:1784045455.011836:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873901568 00000100:00100000:2.0:1784045455.011857:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873901696 00000100:00100000:2.0:1784045455.011860:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873901696 00000100:00100000:2.0:1784045455.011871:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873902080 00000100:00100000:2.0:1784045455.011873:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873902080 00000100:00100000:2.0:1784045455.011883:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873901824 00000100:00100000:2.0:1784045455.011885:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873901824 00000100:00100000:2.0:1784045455.011914:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1784045455.011923:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873901824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045455.011980:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873901824:12345-0@lo:400:kworker.0 Request processed in 59us (7399us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045455.011986:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1784045455.012000:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1784045455.012004:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873901568:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784045455.012022:0:6496:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784045455.012061:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873901568:12345-0@lo:38:kworker.0 Request processed in 55us (7651us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784045455.012067:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1784045455.012080:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784045455.012083:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873901696:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784045455.012093:0:6496:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784045455.012122:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873901696:12345-0@lo:38:kworker.0 Request processed in 37us (7649us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784045455.012127:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1784045455.012137:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1784045455.012141:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873902080:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784045455.012150:0:6496:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784045455.012176:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873902080:12345-0@lo:38:kworker.0 Request processed in 34us (7659us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784045455.012181:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:2.0:1784045455.012217:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045455.012223:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045455.012226:0:6492:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784045455.012322:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873901952:0@lo:400:kworker.0 00010000:00080000:2.0:1784045455.012353:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff939b8237b800 x1870706873901824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045455.012364:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873901824:0@lo:400:kworker.0 00000100:00080000:2.0:1784045455.012402:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb59c7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784045455.012407:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784045455.012411:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873901440:0@lo:38:kworker.0 00000100:00080000:2.0:1784045455.012422:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb5906800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784045455.012426:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784045455.012429:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1870706873901568:0@lo:38:kworker.0 00000100:00080000:2.0:1784045455.012439:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b81989000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784045455.012531:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784045455.012534:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1870706873901696:0@lo:38:kworker.0 00000100:00080000:2.0:1784045455.012545:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b82a1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784045455.012548:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784045455.012551:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1870706873902080:0@lo:38:kworker.0 00010000:00010000:1.0:1784045455.315693:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045455.508111:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045455.508136:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873902464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045455.508207:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045455.508441:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873902464 00000100:00100000:0.0:1784045455.508477:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873902464 00000100:00100000:0.0:1784045455.508539:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784045455.508549:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873902464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784045455.508578:0:8415:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784045455.508642:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873902464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045455.508650:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784045455.508710:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873902464:0@lo:13:osp-pre-1-1.0 00000020:01000004:1.0:1784045455.741613:0:15383:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784045455.758137:0:15383:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1784045455.758203:0:15383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.758219:0:15383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.758226:0:15383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.758233:0:15383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.758251:0:15383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784045455.758257:0:15383:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784045455.758284:0:15383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784045455.758288:0:15383:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784045455.758294:0:15383:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784045455.758299:0:15383:0:(import.c:65:import_set_state_nolock()) ffff939cb5906800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1784045455.758304:0:15383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784045455.758306:0:15383:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784045455.758309:0:15383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784045455.758778:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045455.758859:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045455.758869:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106fc00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1784045455.758873:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045455.758897:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045455.758905:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045455.758911:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784045455.758914:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784045455.758917:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784045455.758959:0:6485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045455.758966:0:6485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045455.758995:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045455.759003:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc106fc00/0x5475624df454c61a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c621 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045455.759013:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045455.759016:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045455.759017:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045455.759108:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873902592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045455.759176:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045455.759323:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873902592 00000100:00100000:2.0:1784045455.759330:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873902592 00000100:00100000:2.0:1784045455.759585:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784045455.759593:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c9fe4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3626:x1870706873902592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784045455.759600:0:6483:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784045455 with bad export cookie 6085878558412292328 00010000:00010000:1.0:1784045455.760979:0:15383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.760994:0:15383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.761012:0:15383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.761019:0:15383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.761082:0:15383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045455.761089:0:15383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.761097:0:15383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.761103:0:15383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.761108:0:15383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.761171:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045455.761177:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.761185:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045455.761188:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.761197:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045455.761215:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045455.761221:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784045455.761224:0:7904:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1784045455.761254:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.761261:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045455.761290:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.761297:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81986000/0x5475624df454c628 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c62f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.761313:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045455.761316:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.761321:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045455.761324:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.761330:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045455.761336:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045455.761341:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784045455.761349:0:7904:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1784045455.761362:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.761368:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045455.761374:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.761382:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045455.761383:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045455.761385:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045455.761468:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873902720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045455.761531:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045455.761584:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045455.761591:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873902848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045455.761611:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045455.761651:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873902720 00000100:00100000:0.0:1784045455.761657:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873902720 00000100:00100000:0.0:1784045455.761684:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873902848 00000100:00100000:0.0:1784045455.761686:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873902848 00000100:00100000:0.0:1784045455.761697:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784045455.761703:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3623:x1870706873902720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784045455.761709:0:6482:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784045455 with bad export cookie 6085878558412292328 00000100:00100000:0.0:1784045455.761749:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3623:x1870706873902720:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (217us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784045455.761757:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784045455.761772:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784045455.761776:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3623:x1870706873902848:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784045455.761781:0:6482:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784045455 with bad export cookie 6085878558412292328 00000100:00100000:0.0:1784045455.761813:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3623:x1870706873902848:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (200us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784045455.761820:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1784045455.761851:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784045455.761855:0:3623:0:(import.c:65:import_set_state_nolock()) ffff939c98523000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1784045455.761860:0:3623:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.144@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1784045455.762118:0:15383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784045455.762125:0:15383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81986600/0x5475624df454c502 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c509 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045455.762142:0:15383:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784045455.762151:0:15383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.762158:0:15383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.762171:0:15383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.762177:0:15383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.762192:0:15383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045455.762198:0:15383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fdc00/0x5475624df454c1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.762205:0:15383:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fdc00/0x5475624df454c1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.762211:0:15383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fdc00/0x5475624df454c1eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.762217:0:15383:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939cc21fdc00/0x5475624df454c1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.762228:0:15383:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1784045455.762231:0:15383:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1784045455.762234:0:15383:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1784045455.762265:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045455.762270:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.762276:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aa000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045455.762280:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.762292:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045455.762299:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045455.762305:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1784045455.762307:0:7904:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784045455.762309:0:7904:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784045455.762345:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045455.762350:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc21fdc00/0x5475624df454c1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.762356:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fdc00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045455.762359:0:6484:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fdc00/0x5475624df454c1eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.762366:0:6484:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc21fdc00/0x5475624df454c1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045455.762373:0:6484:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fdc00/0x5475624df454c1eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045455.762378:0:6484:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784045455.762380:0:6484:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784045455.762382:0:6484:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1784045455.779475:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045455.779783:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c9fe4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3626:x1870706873902592:12345-0@lo:103:ldlm_bl.0 Request processed in 20185us (20602us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784045455.779795:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1784045455.779862:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784045455.802875:0:3623:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.144@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1784045455.802881:0:3623:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784045455.802891:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff939b8237b100 x1870706873901312/t0(0) o400->MGC192.168.203.144@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784045470 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045455.802906:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff939cbf4cca80 x1870706873902592/t0(0) o103->MGC192.168.203.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784045471 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045455.802917:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff939b82880000 x1870706873902720/t0(0) o103->MGC192.168.203.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784045471 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045455.802926:0:3623:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff939b82883100 x1870706873902848/t0(0) o103->MGC192.168.203.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784045471 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784045455.802943:0:3623:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784045455.802946:0:3623:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784045455.802947:0:3623:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000020:01000004:1.0:1784045455.806191:0:15383:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1784045455.806201:0:15383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1784045455.806206:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784045455.806213:0:15383:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1784045455.806220:0:15383:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff939cb680c800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784045455.806226:0:15383:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff939b82182800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784045455.806231:0:15383:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff939c915d0000) has exports, disconnecting them 00000020:00080000:1.0:1784045455.806236:0:15383:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff939cb680c800), last request at 1784045454 00000020:00000080:1.0:1784045455.806244:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c4ca 00000100:00080000:1.0:1784045455.806272:0:15383:0:(import.c:65:import_set_state_nolock()) ffff939cb6808800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784045455.806420:0:15383:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff939cb680c800): rc 0 00000020:00000080:1.0:1784045455.806423:0:15383:0:(genops.c:906:class_export_put()) final put ffff939cb680c800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1784045455.806433:0:15383:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff939b82182800), last request at 1784045455 00000020:00000080:1.0:1784045455.806436:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c3a4 00000100:00080000:1.0:1784045455.806459:0:15383:0:(import.c:65:import_set_state_nolock()) ffff939b82180800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784045455.806466:0:15383:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff939b82182800): rc 0 00000020:00000080:1.0:1784045455.806468:0:15383:0:(genops.c:906:class_export_put()) final put ffff939b82182800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1784045455.806475:0:15383:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb2048193bae0 00000100:00080000:1.0:1784045455.806493:0:15383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784045455.806516:0:15383:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff939b82883800 x1870706873899264/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784045465 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045455.806534:0:15383:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:1.0:1784045455.807611:0:15383:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784045455.807619:0:15383:0:(import.c:65:import_set_state_nolock()) ffff939cb59c7000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:1.0:1784045455.807668:0:7904:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.807677:0:7904:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045455.807698:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.807706:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915aa000/0x5475624df454c89e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c8a5 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045455.807722:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045455.807724:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045455.807727:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045455.807965:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873899264:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784045455.808249:0:6484:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939cc21fdc00/0x5475624df454c1eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.808258:0:6484:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045455.808279:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc21fdc00/0x5475624df454c1eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.808287:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc21fdc00/0x5475624df454c1eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5475624df454c1f2 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045455.808300:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045455.808302:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045455.808303:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045455.808611:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784045455.808705:0:15383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784045455.808710:0:15383:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1784045455.808729:0:15383:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784045455.808785:0:15383:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1784045455.808801:0:15383:0:(import.c:65:import_set_state_nolock()) ffff939b82344000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1784045455.808815:0:15383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784045455.808818:0:15383:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1784045455.808820:0:3626:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff939c98523000 already not connected (conn 1, was 1): DISCONN 00000004:00080000:1.0:1784045455.808826:0:15383:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784045455.808849:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873903232:0@lo:9:umount.0 00000100:00080000:1.0:1784045455.808882:0:15383:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1784045455.808893:0:15383:0:(import.c:65:import_set_state_nolock()) ffff939cb6872000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784045455.808911:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784045455.808928:0:3623:0:(import.c:65:import_set_state_nolock()) ffff939c98523000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784045455.808936:0:3623:0:(import.c:510:import_select_connection()) MGC192.168.203.144@tcp: connect to NID 0@lo last attempt 140 00000100:00080000:0.0:1784045455.808944:0:3623:0:(import.c:624:import_select_connection()) MGC192.168.203.144@tcp: import ffff939c98523000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045455.808974:0:3623:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939c91563480 x1870706873903488/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784045455.808982:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873903232 00000100:00100000:2.0:1784045455.808991:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873903232 00000100:00100000:0.0:1784045455.809005:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873902720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045455.809018:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873901312:0@lo:400:kworker.0 00000100:00100000:2.0:1784045455.809049:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784045455.809052:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0e855152-ca69-43a0-b465-3bf4e35d62f0:3623:1870706873902848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045455.809060:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1870706873903232:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784045455.809097:0:8411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c3f1 00000100:00080000:2.0:1784045455.809106:0:8411:0:(import.c:65:import_set_state_nolock()) ffff939b82343800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784045455.809149:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1784045455.809260:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3622:x1870706873903232:12345-0@lo:9:umount.0 Request processed in 202us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045455.809265:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784045455.809281:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e855152-ca69-43a0-b465-3bf4e35d62f0:3622:1870706873903488:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1784045455.809293:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870706873903488 offset 0 length 520: 4 00000100:00080000:2.0:1784045455.809314:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b82344000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784045455.809318:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784045455.809320:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784045455.809322:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873903232:0@lo:9:umount.0 00010000:00010000:0.0:1784045455.809325:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045455.809343:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0e855152-ca69-43a0-b465-3bf4e35d62f0:0:1870706873902976:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1784045455.809355:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb680c800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1784045455.809404:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82182800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1784045455.809423:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cb6808800 for lustre-MDT0001 00000020:00000080:2.0:1784045455.809426:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b82180800 for lustre-MDT0001 00000100:00100000:2.0:1784045455.809440:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:0:1870706873903104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045455.809466:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0e855152-ca69-43a0-b465-3bf4e35d62f0:3626:1870706873902592:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1784045455.809985:0:15383:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff939c915d0000) has no exports 00000100:00100000:2.0:1784045455.810197:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873903360:0@lo:9:umount.0 00000100:00100000:2.0:1784045455.810240:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045455.810323:0:9935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873903360 00000100:00100000:0.0:1784045455.810329:0:9935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873903360 00000100:00100000:0.0:1784045455.810368:0:9935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784045455.810376:0:9935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3622:x1870706873903360:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784045455.810397:0:9935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c533 00000100:00080000:0.0:1784045455.810404:0:9935:0:(import.c:65:import_set_state_nolock()) ffff939b82056000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784045455.810440:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1784045455.810483:0:9935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1784045455.810627:0:9935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3622:x1870706873903360:12345-0@lo:9:umount.0 Request processed in 251us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045455.810634:0:9935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1784045455.811843:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb6872000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784045455.811867:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784045455.811869:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784045455.811874:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873903360:0@lo:9:umount.0 00000020:00080000:2.0:1784045455.823731:0:15383:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff939c915d0000) has no exports 00000020:01000000:1.0:1784045455.866370:0:15383:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff939b81940a80 - data ffff939caf1dd798/ffff939cc139d800 00000020:01000000:1.0:1784045455.867708:0:15383:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff939c9fda68a0 - data ffff939caf23d6c0/ffff939c91594400 00000001:00000004:1.0:1784045455.878898:0:15383:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1784045455.925731:0:15383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784045455.925738:0:15383:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1784045455.925746:0:15383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784045455.927248:0:15383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784045455.927254:0:15383:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1784045455.927313:0:15383:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784045455.927316:0:15383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784045455.927750:0:8642:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784045455.927755:0:8642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1784045455.927765:0:8642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1784045455.928310:0:15383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784045455.928314:0:15383:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1784045455.928327:0:15383:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784045455.928330:0:15383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784045455.928637:0:9929:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784045455.928641:0:9929:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1784045455.928650:0:9929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1784045455.929738:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c20e 00000020:00000080:2.0:1784045455.929747:0:15383:0:(genops.c:906:class_export_put()) final put ffff939c873ce800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1784045455.930136:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939c873ce800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1784045455.931071:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c223 00000020:00000080:2.0:1784045455.931080:0:15383:0:(genops.c:906:class_export_put()) final put ffff939c8fd4e000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784045455.931096:0:15383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1784045455.931108:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784045455.931115:0:15383:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784045455.931120:0:15383:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff939c915d19c0) has no exports 00000004:01000000:2.0:1784045455.931266:0:15383:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1784045455.931274:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c52c 00000020:00000080:2.0:1784045455.931279:0:15383:0:(genops.c:906:class_export_put()) final put ffff939cbf4bb800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784045455.931283:0:15383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1784045455.931286:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784045455.931293:0:15383:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00000080:0.0:1784045455.931373:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939c8fd4e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1784045455.931381:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cbf4bb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00080000:2.0:1784045455.931409:0:15383:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff939cc13a3380) has no exports 00000020:00000080:2.0:1784045455.931415:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c525 00000020:00000080:2.0:1784045455.931419:0:15383:0:(genops.c:906:class_export_put()) final put ffff939cb6873800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1784045455.931775:0:15383:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1784045455.931780:0:15383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784045455.931783:0:15383:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1784045455.931788:0:15383:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784045455.931791:0:15383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784045455.931818:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784045455.931825:0:15383:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784045455.931829:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c3ea 00000020:00000080:2.0:1784045455.931833:0:15383:0:(genops.c:906:class_export_put()) final put ffff939b82345800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784045455.931836:0:15383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1784045455.931839:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784045455.931842:0:15383:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784045455.931845:0:15383:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff939cb59d19c0) has no exports 00000020:00000080:2.0:1784045455.931849:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c3e3 00000020:00000080:2.0:1784045455.931851:0:15383:0:(genops.c:906:class_export_put()) final put ffff939b82180000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1784045455.932163:0:15383:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1784045455.932166:0:15383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784045455.932169:0:15383:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1784045455.932172:0:15383:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784045455.932173:0:15383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784045455.932206:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784045455.932211:0:15383:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1784045455.932221:0:15383:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1784045455.932226:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c246 00000020:00000080:2.0:1784045455.932231:0:15383:0:(genops.c:906:class_export_put()) final put ffff939cbb2f3000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1784045455.932235:0:15383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1784045455.932237:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784045455.932240:0:15383:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784045455.932243:0:15383:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff939c915d99c0) has no exports 00000020:00000080:2.0:1784045455.932247:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c23f 00000020:00000080:2.0:1784045455.932250:0:15383:0:(genops.c:906:class_export_put()) final put ffff939cb59c4800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1784045455.933210:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb6873800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1784045455.933223:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cb6872000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1784045455.933230:0:37:0:(genops.c:906:class_export_put()) final put ffff939cb6874800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784045455.933232:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb6874800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1784045455.933236:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784045455.933316:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82345800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1784045455.933321:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82180000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1784045455.933326:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b82344000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1784045455.933341:0:37:0:(genops.c:906:class_export_put()) final put ffff939b82185000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784045455.933343:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82185000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1784045455.933348:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784045455.933382:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cbb2f3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1784045455.933387:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb59c4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1784045455.948954:0:15383:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1784045455.948964:0:15383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784045455.948969:0:15383:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1784045455.948978:0:15383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784045455.949042:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784045455.949053:0:15383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784045455.949087:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784045455.949091:0:15383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784045455.949097:0:15383:0:(genops.c:906:class_export_put()) final put ffff939cb5903800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784045455.949102:0:15383:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb5903800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1784045455.949112:0:15383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784045455.949275:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c22a 00000020:00000080:2.0:1784045455.949282:0:15383:0:(genops.c:906:class_export_put()) final put ffff939c8fd4d000/lustre-MDD0001_UUID 00000020:01000000:2.0:1784045455.949287:0:15383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1784045455.949290:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784045455.949393:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cb59c7000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1784045455.949400:0:37:0:(genops.c:906:class_export_put()) final put ffff939c915ef800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784045455.949403:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939c915ef800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1784045455.949410:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1784045455.949509:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939c8fd4d000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1784045455.949582:0:15383:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784045455.949587:0:15383:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff939c915d4d40) has no exports 00000020:00000080:2.0:1784045455.949613:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784045455.949617:0:15383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1784045455.949620:0:15383:0:(genops.c:906:class_export_put()) final put ffff939c98527800/lustre-MDD0001_UUID 00000020:00000080:2.0:1784045455.949622:0:15383:0:(genops.c:865:class_export_destroy()) destroying export ffff939c98527800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1784045455.949634:0:15383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1784045455.949787:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c231 00000020:00000080:2.0:1784045455.949793:0:15383:0:(genops.c:906:class_export_put()) final put ffff939c8fd49800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1784045455.949845:0:15383:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939c9157c000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1784045455.949849:0:15383:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939c9157c000 2 00000020:01000004:2.0:1784045455.949852:0:15383:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff939c9157c000 from lustre-MDT0001 00000020:00000080:2.0:1784045455.949875:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784045455.949879:0:15383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1784045455.949882:0:15383:0:(genops.c:906:class_export_put()) final put ffff939c873cf000/lustre-MDT0001_UUID 00000020:00000080:2.0:1784045455.949884:0:15383:0:(genops.c:865:class_export_destroy()) destroying export ffff939c873cf000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1784045455.949891:0:15383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1784045455.949919:0:15383:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1784045455.949923:0:15383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1784045455.949926:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784045455.949929:0:15383:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784045455.949935:0:15383:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff939cb59c0800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784045455.949940:0:15383:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff939c915d8000) has exports, disconnecting them 00000020:00080000:2.0:1784045455.949944:0:15383:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff939cb59c0800), last request at 1784045203 00000020:00000080:2.0:1784045455.949948:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c285 00000020:00080000:2.0:1784045455.949958:0:15383:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff939cb59c0800): rc 0 00000020:00000080:2.0:1784045455.949962:0:15383:0:(genops.c:906:class_export_put()) final put ffff939cb59c0800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1784045455.949987:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939c8fd49800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1784045455.952517:0:15383:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1784045455.952526:0:15383:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784045455.952531:0:15383:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784045455.952538:0:15383:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784045455.952664:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045455.952673:0:15383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1784045455.952679:0:15383:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939c9157c000 1 00000020:00000080:3.0:1784045455.952685:0:15383:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c1c1 00000020:00000080:3.0:1784045455.952692:0:15383:0:(genops.c:906:class_export_put()) final put ffff939cb5a99000/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1784045455.952697:0:15383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1784045455.952702:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784045455.952706:0:15383:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784045455.952709:0:15383:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff939cb58b19c0) has no exports 00000020:00000080:0.0:1784045455.957880:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb59c0800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1784045455.960635:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939cb5906800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1784045455.960648:0:37:0:(genops.c:906:class_export_put()) final put ffff939cbb2f4000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1784045455.960651:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cbb2f4000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1784045455.960657:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1784045455.960722:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb5a99000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1784045456.006417:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045456.006431:0:15383:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1784045456.006437:0:15383:0:(genops.c:906:class_export_put()) final put ffff939c9157c800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1784045456.006677:0:15383:0:(genops.c:865:class_export_destroy()) destroying export ffff939c9157c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1784045456.006692:0:15383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1784045456.006808:0:15383:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff939c9157e800 00000020:01000000:3.0:1784045456.006830:0:15383:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1784045456.006834:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784045456.006838:0:15383:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784045456.006852:0:15383:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff939c901d19c0) has no exports 00000100:00100000:2.0:1784045456.007080:0:6496:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff939c985d4a00:6496] 0 exiting: rc = 1 00000100:00100000:2.0:1784045456.007203:0:6497:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff939c87898c00:6497] 1 exiting: rc = 0 00000100:00100000:1.0:1784045456.007383:0:10615:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff939b82852000:10615] 3 exiting: rc = 0 00000100:00100000:0.0:1784045456.007686:0:6498:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff939c87899400:6498] 2 exiting: rc = 0 00000100:00100000:3.0:1784045456.007817:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007827:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007833:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007839:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007844:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007849:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007855:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007862:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007868:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007873:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007881:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007886:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007892:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007897:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007903:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007909:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007915:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007920:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007936:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007945:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007950:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007955:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007961:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007966:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007972:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007978:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.007985:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008074:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008081:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008086:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008093:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008099:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008104:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008109:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008127:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008135:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008140:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008145:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008150:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008156:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008162:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008167:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008172:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008178:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008183:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008188:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008193:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008199:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008204:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008209:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008214:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008220:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008225:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008231:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008237:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008243:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008248:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008254:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008259:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008264:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008269:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008274:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008280:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.008285:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045456.011849:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff939c87898800:6499] 0 exiting: rc = 1 00000100:00100000:2.0:1784045456.012090:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff939c93ab6e00:6500] 1 exiting: rc = 0 00000100:00100000:3.0:1784045456.012201:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012209:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012219:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012224:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012230:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012252:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012258:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012264:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012270:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012275:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012280:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012286:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012292:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012297:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012302:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012308:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012312:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012317:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012322:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012326:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012331:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012336:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012342:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012347:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012352:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012357:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012362:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012367:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012372:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012376:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012381:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012386:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012391:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012396:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012401:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012406:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012411:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012417:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012422:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012427:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012440:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012693:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012700:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012704:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012709:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012714:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012719:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012724:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012729:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012734:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012739:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012744:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012749:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012754:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012759:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012764:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012768:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012773:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012778:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012785:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012790:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012797:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012802:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.012808:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045456.013348:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff939c93ab6600:6502] 1 exiting: rc = 0 00000100:00100000:2.0:1784045456.013496:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff939c93ab7e00:6501] 0 exiting: rc = 1 00000100:00100000:2.0:1784045456.013577:0:7897:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff939cc104b000:7897] 2 exiting: rc = 0 00000100:00100000:3.0:1784045456.013770:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013777:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013784:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013798:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013805:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013811:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013816:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013822:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013834:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013841:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013846:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013862:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013868:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013874:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013879:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013884:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013890:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013896:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013902:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013908:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013929:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013935:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013941:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013946:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013951:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013956:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013961:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013968:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013974:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013979:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.013985:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014001:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014021:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014029:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014045:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014051:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014057:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014063:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014068:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014074:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014079:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014085:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014091:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014097:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014116:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014123:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014135:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014140:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014146:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014151:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014157:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014164:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014170:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014176:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014181:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014186:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014207:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014215:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014220:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014226:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014232:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014238:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014243:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.014248:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045456.030063:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff939c93ab6800:6503] 0 exiting: rc = 1 00000100:00100000:1.0:1784045456.030160:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff939c885c8e00:6504] 1 exiting: rc = 0 00000100:00100000:3.0:1784045456.030253:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030261:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030267:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030271:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030277:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030282:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030287:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030291:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030297:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030302:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030308:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030312:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030316:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030321:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030326:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030331:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030336:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030354:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030359:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030365:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030370:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030374:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030380:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030385:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030390:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030395:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030399:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030405:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030410:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030415:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030419:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030424:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030429:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030434:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030440:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030474:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030480:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030486:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030491:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030495:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030500:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030506:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030520:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030525:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030530:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030535:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030540:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030545:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030549:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030554:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030559:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030564:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030576:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030581:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030585:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030590:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030595:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030599:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030604:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030609:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030614:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030619:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030624:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.030629:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045456.031252:0:6506:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff939c885c9c00:6506] 1 exiting: rc = 0 00000100:00100000:1.0:1784045456.032708:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff939c885c8400:6505] 0 exiting: rc = 1 00000100:00100000:3.0:1784045456.032847:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032855:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032860:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032865:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032870:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032875:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032879:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032884:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032890:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032895:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032899:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032904:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032909:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032914:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032919:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032924:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032928:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032933:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032937:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032942:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032946:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032952:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032957:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032973:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032978:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032984:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.032988:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033005:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033009:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033014:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033019:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033024:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033028:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033042:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033048:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033053:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033057:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033062:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033067:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033072:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033077:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033082:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033087:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033092:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033097:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033102:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033106:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033111:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033115:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033119:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033124:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033129:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033133:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033138:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033142:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033146:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033150:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033154:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033167:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033172:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033177:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033182:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033187:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.033191:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045456.033943:0:6507:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff939c885c8000:6507] 0 exiting: rc = 1 00000100:00100000:2.0:1784045456.034255:0:6508:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff939c885c9a00:6508] 1 exiting: rc = 0 00000100:00100000:3.0:1784045456.034321:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034328:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034333:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034338:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034343:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034349:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034354:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034358:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034363:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034369:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034374:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034380:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034385:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034390:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034396:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034401:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034406:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034411:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034416:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034421:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034425:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034430:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034435:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034440:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034473:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034479:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034484:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034488:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034493:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034506:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034520:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034525:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034530:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034535:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034540:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034545:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034550:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034555:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034560:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034565:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034570:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034574:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034579:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034584:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034589:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034595:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034600:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034605:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034609:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034614:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034618:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034622:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034625:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034628:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034631:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034635:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034637:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034640:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034643:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034646:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034649:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034652:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034655:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.034658:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045456.035489:0:6510:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff939c9fd8a800:6510] 1 exiting: rc = 0 00000100:00100000:0.0:1784045456.044176:0:6509:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff939c9fd8b000:6509] 0 exiting: rc = 1 00000100:00100000:0.0:1784045456.044408:0:6511:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff939c9fd8ac00:6511] 2 exiting: rc = 0 00000100:00100000:3.0:1784045456.044810:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044819:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044826:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044832:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044855:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044862:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044867:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044872:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044877:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044883:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044888:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044894:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044899:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044904:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044910:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044916:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044922:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044927:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044933:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044938:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044943:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044949:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044956:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044962:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044968:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044973:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044978:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.044984:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045016:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045023:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045028:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045044:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045050:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045055:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045060:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045075:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045082:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045087:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045093:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045098:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045103:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045108:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045114:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045119:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045125:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045130:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045135:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045140:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045145:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045151:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045157:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045169:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045192:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045200:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045206:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045213:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045218:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045225:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045230:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045237:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045243:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045248:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045254:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045456.045260:0:15383:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784045456.049061:0:15383:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045456.049076:0:15383:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1784045456.049082:0:15383:0:(genops.c:906:class_export_put()) final put ffff939c98525800/MDS_uuid 00000020:00000080:3.0:1784045456.049088:0:15383:0:(genops.c:865:class_export_destroy()) destroying export ffff939c98525800/MDS_uuid for MDS 00000020:01000000:3.0:1784045456.049098:0:15383:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1784045456.049245:0:15383:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1784045456.339704:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045457.363613:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045458.387596:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045459.415892:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784045459.896804:0:15584:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1784045459.919004:0:15584:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1784045459.919067:0:15584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045459.919080:0:15584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045459.919087:0:15584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045459.919095:0:15584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045459.919117:0:15584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784045459.919122:0:15584:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784045459.919146:0:15584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784045459.919150:0:15584:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784045459.919155:0:15584:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784045459.919161:0:15584:0:(import.c:65:import_set_state_nolock()) ffff939b81989000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1784045459.919166:0:15584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784045459.919168:0:15584:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784045459.919171:0:15584:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1784045459.919993:0:15584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784045459.919997:0:15584:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784045459.920001:0:15584:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00010000:00010000:2.0:1784045459.920029:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1784045459.920035:0:15584:0:(import.c:65:import_set_state_nolock()) ffff939c8fd28000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1784045459.920039:0:7904:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045459.920066:0:7904:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106f800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1784045459.920070:0:7904:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045459.920079:0:7904:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045459.920086:0:7904:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045459.920092:0:7904:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784045459.920094:0:7904:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784045459.920097:0:7904:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784045459.920110:0:7904:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939c98523000 00010000:00010000:2.0:1784045459.920114:0:7904:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045459.920120:0:7904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc106f800/0x5475624df454c5fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c605 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045459.920133:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045459.920134:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045459.920136:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045459.920157:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1870706873903616:0@lo:39:umount.0 00000400:00000100:2.0:1784045459.920211:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870706873903616 offset 0 length 224: 4 00000100:00080000:1.0:1784045460.115619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0e855152-ca69-43a0-b465-3bf4e35d62f0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784045460.115628:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0e855152-ca69-43a0-b465-3bf4e35d62f0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784045460.115632:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784045460.115636:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784045460.115640:0:37:0:(import.c:65:import_set_state_nolock()) ffff939b82a1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784045460.115647:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 411 00000100:00080000:1.0:1784045460.115653:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784045460.115660:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff939b82a1c000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1784045460.115700:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b836d2d80 x1870706873903744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784045460.115801:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873903872:0@lo:400:kworker.0 00000400:00000100:0.0:1784045460.115851:0:3623:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870706873903872 offset 0 length 224: 4 00000100:00100000:2.0:1784045460.116210:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1870706873903744:0@lo:38:kworker.0 00000400:00000100:2.0:1784045460.116233:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870706873903744 offset 0 length 520: 4 00010000:00010000:1.0:1784045460.435844:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045461.461014:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784045461.657322:0:8407:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1784045461.657331:0:8407:0:(genops.c:906:class_export_put()) final put ffff939b82343000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1784045461.657408:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82343000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1784045461.657505:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b82343800 for lustre-OST0000 00000001:00100000:2.0:1784045461.664876:0:9491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1784045461.664887:0:9491:0:(genops.c:906:class_export_put()) final put ffff939b82051800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1784045461.664987:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82051800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784045461.665073:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b82056000 for lustre-OST0001 00010000:00010000:2.0:1784045462.483974:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045463.508576:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045464.531978:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045465.235625:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045455/real 1784045455] req@ffff939c91563480 x1870706873903488/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784045465 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045465.235660:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939c91563480 x1870706873903488/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784045465 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784045465.235691:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c98523000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045465.235718:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1784045465.235723:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e855152-ca69-43a0-b465-3bf4e35d62f0:3622:1870706873903488:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1784045465.235878:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0e855152-ca69-43a0-b465-3bf4e35d62f0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784045465.235883:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1784045465.235886:0:38:0:(import.c:65:import_set_state_nolock()) ffff939c98523000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784045465.235890:0:38:0:(import.c:510:import_select_connection()) MGC192.168.203.144@tcp: connect to NID 0@lo last attempt 411 00000100:00080000:0.0:1784045465.235895:0:38:0:(import.c:589:import_select_connection()) MGC192.168.203.144@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784045465.235902:0:38:0:(import.c:624:import_select_connection()) MGC192.168.203.144@tcp: import ffff939c98523000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045465.235933:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939c91562300 x1870706873904000/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784045465.235957:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784045465.235961:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784045465.236064:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045465.236075:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e855152-ca69-43a0-b465-3bf4e35d62f0:3622:1870706873904000:0@lo:250:kworker.0 00000100:00100000:2.0:1784045465.236078:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873904128:0@lo:400:kworker.0 00000400:00000100:2.0:1784045465.237828:0:3623:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870706873904128 offset 0 length 224: 4 00000400:00000100:3.0:1784045465.240005:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870706873904000 offset 0 length 520: 4 00010000:00010000:2.0:1784045465.557949:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045466.579717:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045467.606422:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045468.628526:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045469.331976:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045459/real 1784045459] req@ffff939b82883b80 x1870706873903616/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784045469 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045469.332031:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939b82883b80 x1870706873903616/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784045469 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784045469.332058:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c8fd28000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784045469.332084:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1870706873903616:0@lo:39:umount.0 00000100:00080000:0.0:1784045469.332230:0:15584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784045469.332236:0:15584:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784045469.332251:0:15584:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1784045469.333414:0:15584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045469.333476:0:15584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045469.333487:0:15584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045469.333494:0:15584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045469.333524:0:15584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784045469.333550:0:15584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045469.333557:0:15584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045469.333564:0:15584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045469.333571:0:15584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045469.333592:0:15584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1784045469.333597:0:15584:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1784045469.333630:0:15584:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1784045469.333637:0:15584:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1784045469.333642:0:15584:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784045469.333650:0:15584:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784045469.333655:0:15584:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff939b819b0000) has no exports 00000020:00080000:0.0:1784045469.333685:0:15584:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff939b819b0000) has no exports 00010000:00010000:3.0:1784045469.333778:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045469.333787:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045469.333796:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aba00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045469.333799:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045469.333935:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045469.333942:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045469.333957:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784045469.333960:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1784045469.333963:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1784045469.333983:0:6485:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939c98523000 00010000:00010000:3.0:1784045469.333995:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045469.334002:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915aba00/0x5475624df454c60c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c613 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045469.334019:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045469.334022:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045469.334029:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fd000 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045469.334031:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045469.334037:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045469.334043:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045469.334059:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784045469.334061:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784045469.334063:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784045469.334071:0:6485:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939c98523000 00010000:00010000:3.0:1784045469.334073:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045469.334079:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc21fd000/0x5475624df454c890 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c897 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045469.334088:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045469.334089:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045469.334091:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045469.335234:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1784045469.340409:0:15584:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff939b8195ecc0 - data ffff939b81ce0948/ffff939b828e2000 00000020:01000000:0.0:1784045469.340890:0:15584:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff939cb593d480 - data ffff939caf2916c0/ffff939b82339400 00100000:10000000:0.0:1784045469.351082:0:15584:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1784045469.369481:0:15584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c35e 00000020:00000080:3.0:1784045469.369499:0:15584:0:(genops.c:906:class_export_put()) final put ffff939b8198e800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1784045469.369513:0:15584:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939cc10ba000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1784045469.369518:0:15584:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939cc10ba000 2 00000020:01000004:3.0:1784045469.369522:0:15584:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff939cc10ba000 from lustre-OST0000 00000020:00000080:3.0:1784045469.369550:0:15584:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045469.369564:0:15584:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1784045469.369568:0:15584:0:(genops.c:906:class_export_put()) final put ffff939b8198f800/lustre-OST0000_UUID 00000020:00000080:3.0:1784045469.369572:0:15584:0:(genops.c:865:class_export_destroy()) destroying export ffff939b8198f800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1784045469.369579:0:15584:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1784045469.369646:0:15584:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1784045469.369651:0:15584:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1784045469.369654:0:15584:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784045469.369660:0:15584:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784045469.369667:0:15584:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff939b8198b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784045469.369675:0:15584:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff939b819b4d40) has exports, disconnecting them 00000020:00080000:3.0:1784045469.369693:0:15584:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff939b8198b000), last request at 1784045222 00000020:00000080:3.0:1784045469.369699:0:15584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c388 00000020:00080000:3.0:1784045469.369708:0:15584:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff939b8198b000): rc 0 00000020:00000080:3.0:1784045469.369715:0:15584:0:(genops.c:906:class_export_put()) final put ffff939b8198b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1784045469.370528:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939b8198e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1784045469.370549:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939b8198b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1784045469.370577:0:15584:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1784045469.370582:0:15584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784045469.370587:0:15584:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784045469.370595:0:15584:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784045469.370620:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b81989000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1784045469.370731:0:15584:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784045469.370738:0:15584:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1784045469.370742:0:15584:0:(genops.c:906:class_export_put()) final put ffff939b8198f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1784045469.370745:0:15584:0:(genops.c:865:class_export_destroy()) destroying export ffff939b8198f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1784045469.370749:0:15584:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1784045469.370818:0:15584:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1784045469.370823:0:15584:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784045469.370827:0:15584:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784045469.370833:0:15584:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff939c8fd3b800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784045469.370838:0:15584:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff939cb59d3380) has exports, disconnecting them 00000020:00080000:2.0:1784045469.370843:0:15584:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff939c8fd3b800), last request at 1784045223 00000020:00000080:2.0:1784045469.370846:0:15584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c39d 00000020:00080000:2.0:1784045469.370870:0:15584:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff939c8fd3b800): rc 0 00000020:00000080:2.0:1784045469.370875:0:15584:0:(genops.c:906:class_export_put()) final put ffff939c8fd3b800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1784045469.370906:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c8fd3b800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1784045469.389044:0:15584:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1784045469.389056:0:15584:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784045469.389062:0:15584:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784045469.389072:0:15584:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784045469.389410:0:15584:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784045469.389423:0:15584:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1784045469.389527:0:15584:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939cc10ba000 1 00000020:00000080:2.0:1784045469.389536:0:15584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c326 00000020:00000080:2.0:1784045469.389547:0:15584:0:(genops.c:906:class_export_put()) final put ffff939cc1273800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1784045469.389705:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939c8fd28000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1784045469.389715:0:38:0:(genops.c:906:class_export_put()) final put ffff939c8fd3e800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1784045469.389718:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939c8fd3e800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1784045469.389731:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000000:2.0:1784045469.389889:0:15584:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1784045469.389894:0:15584:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784045469.389899:0:15584:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784045469.389904:0:15584:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff939cb58b0000) has no exports 00000020:00000080:1.0:1784045469.393090:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff939cc1273800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1784045469.415376:0:15584:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784045469.415395:0:15584:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1784045469.415402:0:15584:0:(genops.c:906:class_export_put()) final put ffff939cc10b8800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1784045469.415408:0:15584:0:(genops.c:865:class_export_destroy()) destroying export ffff939cc10b8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1784045469.415421:0:15584:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1784045469.415712:0:15584:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff939cc10bb000 00000020:02000400:1.0:1784045469.415777:0:15584:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1784045469.658178:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784045470.366105:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0e855152-ca69-43a0-b465-3bf4e35d62f0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784045470.366119:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0e855152-ca69-43a0-b465-3bf4e35d62f0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784045470.366121:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784045470.366125:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784045470.366225:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784045470.366251:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873904256:0@lo:400:kworker.0 00000400:00000100:3.0:1784045470.366507:0:3626:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870706873904256 offset 0 length 224: 4 00010000:00010000:3.0:1784045470.695285:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045471.713591:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045472.724638:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784045473.734710:0:15786:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1784045473.744552:0:15786:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1784045473.744719:0:15786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045473.744734:0:15786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045473.744762:0:15786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045473.744769:0:15786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045473.744795:0:15786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784045473.744801:0:15786:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1784045473.744826:0:15786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784045473.744837:0:15786:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff939b836d2d80 x1870706873903744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784045480 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045473.744854:0:15786:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784045473.744885:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b82a1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784045473.744899:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1784045473.744903:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1870706873903744:0@lo:38:kworker.0 00000100:00080000:0.0:1784045473.744937:0:15786:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1784045473.744942:0:15786:0:(import.c:65:import_set_state_nolock()) ffff939b82a1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1784045473.744946:0:15786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784045473.744948:0:15786:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784045473.744951:0:15786:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784045473.745417:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045473.745425:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045473.745433:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987e00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045473.745437:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045473.745471:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045473.745480:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045473.745486:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784045473.745498:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784045473.745501:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784045473.745521:0:6485:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939c98523000 00010000:00010000:3.0:1784045473.745524:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045473.745531:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81987e00/0x5475624df454c5e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c5e9 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045473.745543:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045473.745545:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045473.745546:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784045473.745557:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0e855152-ca69-43a0-b465-3bf4e35d62f0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784045473.745561:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0e855152-ca69-43a0-b465-3bf4e35d62f0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784045473.745633:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045473.745649:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873904384:0@lo:400:kworker.0 00000400:00000100:3.0:1784045473.745698:0:3625:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870706873904384 offset 0 length 224: 4 00000100:00080000:0.0:1784045473.747130:0:15786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784045473.747143:0:15786:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff939b836d3480 x1870706873903872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045476 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045473.747170:0:15786:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff939c91560a80 x1870706873904128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045481 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045473.747178:0:15786:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff939b82883b80 x1870706873904256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045486 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045473.747211:0:15786:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff939b82881c00 x1870706873904384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045489 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045473.747221:0:15786:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1784045473.747227:0:15786:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1784045473.747249:0:15786:0:(import.c:65:import_set_state_nolock()) ffff939b82a1e800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784045473.747282:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1870706873904512:0@lo:39:umount.0 00000100:00100000:2.0:1784045473.747437:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873904256:0@lo:400:kworker.0 00000100:00100000:3.0:1784045473.748478:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91560a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873904128:0@lo:400:kworker.0 00000100:00100000:3.0:1784045473.748490:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1870706873903872:0@lo:400:kworker.0 00000100:00100000:3.0:1784045473.748527:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873904384:0@lo:400:kworker.0 00000400:00000100:0.0:1784045473.749942:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870706873904512 offset 0 length 224: 4 00010000:00010000:3.0:1784045473.750132:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045474.773480:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045475.802753:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045476.819728:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045477.845690:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045478.868530:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784045479.059807:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0e855152-ca69-43a0-b465-3bf4e35d62f0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784045479.059822:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 0e855152-ca69-43a0-b465-3bf4e35d62f0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1784045479.891903:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045480.918983:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045480.919359:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045465/real 1784045465] req@ffff939c91562300 x1870706873904000/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784045480 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045480.919396:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939c91562300 x1870706873904000/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784045480 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784045480.919420:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c98523000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784045480.919490:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1784045480.919495:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e855152-ca69-43a0-b465-3bf4e35d62f0:3622:1870706873904000:0@lo:250:kworker.0 00000100:00080000:1.0:1784045480.923068:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0e855152-ca69-43a0-b465-3bf4e35d62f0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784045480.923084:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1784045480.923090:0:37:0:(import.c:65:import_set_state_nolock()) ffff939c98523000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784045480.923099:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.144@tcp: connect to NID 0@lo last attempt 421 00000100:00080000:1.0:1784045480.923107:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.144@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784045480.923117:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.144@tcp: import ffff939c98523000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1784045480.923239:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b836d1c00 x1870706873904640/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784045480.923431:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e855152-ca69-43a0-b465-3bf4e35d62f0:3622:1870706873904640:0@lo:250:kworker.0 00000400:00000100:2.0:1784045480.923536:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870706873904640 offset 0 length 520: 4 00010000:00010000:3.0:1784045481.939850:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045482.963843:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045483.987686:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045473/real 1784045473] req@ffff939c91563480 x1870706873904512/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784045483 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045483.987721:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939c91563480 x1870706873904512/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784045483 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784045483.987740:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b82a1e800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784045483.987759:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1870706873904512:0@lo:39:umount.0 00000100:00080000:1.0:1784045483.987838:0:15786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784045483.987848:0:15786:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784045483.987856:0:15786:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784045483.987876:0:7904:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045483.988840:0:15786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045483.988867:0:15786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045483.988876:0:15786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045483.988883:0:15786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045483.988911:0:15786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045483.988920:0:15786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045483.988927:0:15786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045483.988933:0:15786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045483.988940:0:15786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045483.988970:0:15786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1784045483.988975:0:15786:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:3.0:1784045483.988979:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045483.988990:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045483.989001:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc2171a00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045483.989006:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784045483.989007:0:15786:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1784045483.989015:0:15786:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:3.0:1784045483.989019:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784045483.989021:0:15786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 10000000:00010000:3.0:1784045483.989031:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784045483.989031:0:15786:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 10000000:01000000:3.0:1784045483.989039:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784045483.989044:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00000020:00080000:1.0:1784045483.989047:0:15786:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff939b819b3380) has no exports 10000000:01000000:3.0:1784045483.989048:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1784045483.989068:0:6485:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939c98523000 00010000:00010000:3.0:1784045483.989073:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045483.989081:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939cc2171a00/0x5475624df454c5f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c5f7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784045483.989081:0:15786:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff939b819b3380) has no exports 00010000:00010000:3.0:1784045483.989100:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045483.989104:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045483.989109:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915abc00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045483.989119:0:6485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045483.989126:0:6485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045483.989133:0:6485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045483.989138:0:6485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784045483.989141:0:6485:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784045483.989142:0:6485:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784045483.989152:0:6485:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939c98523000 00010000:00010000:3.0:1784045483.989154:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045483.989159:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915abc00/0x5475624df454c882 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c889 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045483.989174:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045483.989175:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045483.989177:0:6485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1784045483.990828:0:15786:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff939b8195e9c0 - data ffff939b81ce0bd0/ffff939cc12b0400 00010000:00010000:0.0:1784045483.993778:0:6484:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1784045483.993947:0:15786:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff939c91bf9f00 - data ffff939caf316360/ffff939b832ab400 00100000:10000000:1.0:1784045484.004322:0:15786:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1784045484.018234:0:15786:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c484 00000020:00000080:0.0:1784045484.018250:0:15786:0:(genops.c:906:class_export_put()) final put ffff939b82a19000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1784045484.018267:0:15786:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939b82301000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1784045484.018271:0:15786:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939b82301000 2 00000020:01000004:0.0:1784045484.018275:0:15786:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff939b82301000 from lustre-OST0001 00000020:00000080:0.0:1784045484.018308:0:15786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045484.018321:0:15786:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1784045484.018325:0:15786:0:(genops.c:906:class_export_put()) final put ffff939cb59c7800/lustre-OST0001_UUID 00000020:00000080:0.0:1784045484.018328:0:15786:0:(genops.c:865:class_export_destroy()) destroying export ffff939cb59c7800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1784045484.018345:0:15786:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1784045484.018493:0:15786:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 0e855152-ca69-43a0-b465-3bf4e35d62f0->MGS 00010000:00010000:0.0:1784045484.018526:0:15786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915aa600/0x5475624df454c1dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c1e4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784045484.018564:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82a19000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:00010000:0.0:1784045484.018616:0:15786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915aa600/0x5475624df454c1dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c1e4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045484.018623:0:15786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1784045484.018626:0:15786:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1784045484.018629:0:15786:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1784045484.018660:0:15786:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939c98523000 00010000:00010000:0.0:1784045484.018664:0:15786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915aa600/0x5475624df454c1dd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c1e4 expref: -99 pid: 7426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045484.018682:0:15786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c915ab000/0x5475624df454c652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5475624df454c659 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784045484.018689:0:15786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c915ab000/0x5475624df454c652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5475624df454c659 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045484.018695:0:15786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784045484.018698:0:15786:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1784045484.018700:0:15786:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1784045484.018709:0:15786:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff939c98523000 00010000:00010000:0.0:1784045484.018712:0:15786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c915ab000/0x5475624df454c652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5475624df454c659 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784045484.018732:0:15786:0:(import.c:65:import_set_state_nolock()) ffff939c98523000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1784045484.018736:0:15786:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784045484.018738:0:15786:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784045484.018747:0:15786:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1784045484.018751:0:15786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784045484.018766:0:15786:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff939b836d1c00 x1870706873904640/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784045500 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784045484.018785:0:15786:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1784045484.018789:0:15786:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:2.0:1784045484.018872:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0e855152-ca69-43a0-b465-3bf4e35d62f0:3622:1870706873904640:0@lo:250:kworker.0 10000000:01000000:0.0:1784045484.018972:0:15786:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1784045484.018981:0:15786:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c0da 00000020:00000080:0.0:1784045484.018989:0:15786:0:(genops.c:906:class_export_put()) final put ffff939c98523800/0e855152-ca69-43a0-b465-3bf4e35d62f0 00000020:01000000:0.0:1784045484.018995:0:15786:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.144@tcp (flags='') 00000020:00000080:0.0:1784045484.019000:0:15786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784045484.019005:0:15786:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.144@tcp: forcing exports to disconnect: 0/3 00000020:00000080:2.0:1784045484.019008:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939c98523800/0e855152-ca69-43a0-b465-3bf4e35d62f0 for MGC192.168.203.144@tcp 00000020:00080000:0.0:1784045484.019010:0:15786:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff939c901d3380) has no exports 10000000:01000000:2.0:1784045484.019040:0:6493:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1784045484.019161:0:15786:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.144@tcp: client import never connected 00000100:00080000:0.0:1784045484.019164:0:15786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1784045484.019166:0:15786:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1784045484.019168:0:15786:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1784045484.019170:0:15786:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1784045484.019230:0:15786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784045484.019235:0:15786:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.144@tcp (uuid 0e855152-ca69-43a0-b465-3bf4e35d62f0) 00000020:01000000:0.0:1784045484.019242:0:15786:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1784045484.019245:0:15786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784045484.019249:0:15786:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784045484.019253:0:15786:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff939b82a1c800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784045484.019259:0:15786:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff939b819b19c0) has exports, disconnecting them 00000020:00080000:0.0:1784045484.019263:0:15786:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff939b82a1c800), last request at 1784045242 00000020:00000080:0.0:1784045484.019267:0:15786:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c4ae 00000020:00080000:0.0:1784045484.019278:0:15786:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff939b82a1c800): rc 0 00000020:00000080:0.0:1784045484.019282:0:15786:0:(genops.c:906:class_export_put()) final put ffff939b82a1c800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1784045484.019674:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939c98523000 for MGC192.168.203.144@tcp 00000020:00000080:2.0:1784045484.019682:0:37:0:(genops.c:906:class_export_put()) final put ffff939c98522000/0e855152-ca69-43a0-b465-3bf4e35d62f0 00000020:00000080:2.0:1784045484.019685:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939c98522000/0e855152-ca69-43a0-b465-3bf4e35d62f0 for MGC192.168.203.144@tcp 00000020:01000000:2.0:1784045484.019690:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.144@tcp (0e855152-ca69-43a0-b465-3bf4e35d62f0) 00000020:00000080:2.0:1784045484.020661:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82a1c800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1784045484.022779:0:15786:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1784045484.022788:0:15786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784045484.022793:0:15786:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784045484.022802:0:15786:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784045484.023002:0:15786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784045484.023013:0:15786:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1784045484.023022:0:15786:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1784045484.023027:0:15786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784045484.023032:0:15786:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784045484.023040:0:15786:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff939b833ae000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784045484.023048:0:15786:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff939b832619c0) has exports, disconnecting them 00000020:00080000:2.0:1784045484.023053:0:15786:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff939b833ae000), last request at 1784045242 00000020:00000080:2.0:1784045484.023058:0:15786:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c4c3 00000020:00080000:2.0:1784045484.023089:0:15786:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff939b833ae000): rc 0 00000020:00000080:2.0:1784045484.023095:0:15786:0:(genops.c:906:class_export_put()) final put ffff939b833ae000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1784045484.023425:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b82a1c000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1784045484.023433:0:37:0:(genops.c:906:class_export_put()) final put ffff939b82a1b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1784045484.023436:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82a1b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1784045484.023465:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1784045484.023542:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939b833ae000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1784045484.028030:0:15786:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1784045484.028043:0:15786:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784045484.028047:0:15786:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784045484.028069:0:15786:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784045484.028105:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff939b82a1e800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1784045484.028159:0:7904:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1784045484.028297:0:6485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1784045484.031545:0:6484:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1784045484.032900:0:6479:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff939c878aca00:6479] 0 exiting: rc = 1 00000100:00100000:3.0:1784045484.033731:0:6480:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff939cb0cc3000:6480] 1 exiting: rc = 0 00000100:00100000:3.0:1784045484.033818:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.034159:0:9500:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff939cc126b000:9500] 3 exiting: rc = 0 00000100:00100000:3.0:1784045484.034248:0:6483:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff939c838a2200:6483] 2 exiting: rc = 0 00000100:00100000:0.0:1784045484.035708:0:6481:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff939c878c5000:6481] 0 exiting: rc = 1 00000100:00100000:0.0:1784045484.036149:0:6482:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff939c838a3000:6482] 1 exiting: rc = 0 00000100:00100000:3.0:1784045484.036289:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036300:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036311:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036331:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036339:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036346:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036352:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036358:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036364:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036371:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036378:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036384:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036391:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036398:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036405:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036411:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036417:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036423:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036430:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036438:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036468:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036476:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036481:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036487:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036501:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036509:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036514:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036520:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036526:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036532:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036538:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036544:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036554:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036560:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036566:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036572:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036577:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036583:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036589:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036595:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036601:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036606:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036612:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036617:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036623:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036628:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036634:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036640:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036645:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036651:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036657:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036663:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036668:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036673:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036678:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036683:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036689:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036694:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036700:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036714:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036719:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036724:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036730:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.036735:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784045484.039191:0:15786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784045484.039206:0:15786:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1784045484.039214:0:15786:0:(genops.c:906:class_export_put()) final put ffff939b82a1d800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1784045484.039219:0:15786:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82a1d800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1784045484.039226:0:15786:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1784045484.039292:0:15786:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939b82301000 1 00000020:00000080:3.0:1784045484.039301:0:15786:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5475624df454c453 00000020:00000080:3.0:1784045484.039309:0:15786:0:(genops.c:906:class_export_put()) final put ffff939b82050800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1784045484.039322:0:15786:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1784045484.039332:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82050800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1784045484.039346:0:15786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784045484.039352:0:15786:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784045484.039356:0:15786:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff939cb58b4d40) has no exports 00000020:00000080:1.0:1784045484.081123:0:15786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784045484.081143:0:15786:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1784045484.081151:0:15786:0:(genops.c:906:class_export_put()) final put ffff939b82307000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1784045484.081157:0:15786:0:(genops.c:865:class_export_destroy()) destroying export ffff939b82307000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1784045484.081170:0:15786:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1784045484.081568:0:15786:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff939b82306000 00000020:01000000:1.0:1784045484.081652:0:15786:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1784045484.081657:0:15786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784045484.081663:0:15786:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784045484.081668:0:15786:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff939c9fddcd40) has no exports 00000020:00000080:1.0:1784045484.081699:0:15786:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784045484.081704:0:15786:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1784045484.081719:0:15786:0:(genops.c:906:class_export_put()) final put ffff939cc1272000/OSS_uuid 00000020:00000080:1.0:1784045484.081722:0:15786:0:(genops.c:865:class_export_destroy()) destroying export ffff939cc1272000/OSS_uuid for OSS 00000020:01000000:1.0:1784045484.081726:0:15786:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1784045484.081892:0:6492:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1784045484.081904:0:9935:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff939c8826ba00:9935] 4 exiting: rc = 0 00000100:00100000:1.0:1784045484.082026:0:8648:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff939b823e5a00:8648] 3 exiting: rc = 0 00000100:00100000:2.0:1784045484.082096:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff939cb6b88c00:8413] 2 exiting: rc = 0 00000100:00100000:2.0:1784045484.082175:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff939c9e61b200:8412] 1 exiting: rc = 0 00000100:00100000:3.0:1784045484.087157:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff939c985d1c00:8411] 0 exiting: rc = 1 00000100:00100000:1.0:1784045484.089969:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.089983:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.089991:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090000:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090008:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090015:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090021:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090027:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090033:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090056:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090062:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090068:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090074:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090080:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090086:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090092:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090098:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090104:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090111:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090116:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090122:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090128:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090133:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090139:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090145:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090150:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090156:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090161:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090166:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090171:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090177:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090182:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090188:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090195:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090201:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090206:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090212:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090217:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090223:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090229:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090234:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090240:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090246:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090252:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090265:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090271:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090277:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090282:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090288:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090294:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090300:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090306:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090311:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090317:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090323:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090329:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090334:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090340:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090345:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090351:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090356:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090362:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090368:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.090381:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784045484.091897:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff939cb6b8b000:8415] 0 exiting: rc = 1 00000100:00100000:0.0:1784045484.091909:0:8416:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff939cb6b8ac00:8416] 1 exiting: rc = 0 00000100:00100000:3.0:1784045484.092033:0:9537:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff939b82a89e00:9537] 2 exiting: rc = 0 00000100:00100000:0.0:1784045484.092081:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092090:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092099:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092106:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092111:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092120:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092126:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092132:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092138:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092144:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092148:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092152:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092155:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092158:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092162:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092170:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092174:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092176:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092181:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092185:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092190:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092195:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092200:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092205:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092210:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092217:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092222:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092228:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092234:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092239:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092244:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092251:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092256:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092262:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092282:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092306:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092314:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092320:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092325:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092330:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092336:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092341:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092347:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092353:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092359:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092364:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092369:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092374:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092380:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092386:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092393:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092399:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092405:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092411:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092415:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092418:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092422:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092426:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092430:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092434:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092437:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092441:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092478:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.092483:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784045484.096680:0:8418:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff939cb6b8a400:8418] 1 exiting: rc = 0 00000100:00100000:0.0:1784045484.097030:0:8419:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff939cb5ab5200:8419] 2 exiting: rc = 0 00000100:00100000:0.0:1784045484.099834:0:8417:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff939cb6b8be00:8417] 0 exiting: rc = 1 00000100:00100000:1.0:1784045484.100216:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100228:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100235:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100241:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100247:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100254:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100261:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100267:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100274:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100280:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100287:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100294:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100300:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100307:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100313:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100347:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100358:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100366:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100373:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100379:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100386:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100392:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100398:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100404:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100423:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100430:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100437:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100476:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100483:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100489:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100494:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100500:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100509:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100515:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100522:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100527:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100533:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100539:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100544:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100551:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100557:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100564:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100572:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100580:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100586:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100593:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100599:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100604:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100624:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100632:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100647:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100652:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100658:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100665:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100671:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100677:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100683:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100690:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100705:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100719:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100727:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100733:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100739:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.100752:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784045484.108580:0:8420:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff939cb5ab4200:8420] 0 exiting: rc = 1 00000100:00100000:2.0:1784045484.108730:0:8421:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff939cb5ab4800:8421] 1 exiting: rc = 0 00000100:00100000:0.0:1784045484.108885:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108895:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108901:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108926:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108931:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108937:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108943:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108948:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108954:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108960:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108966:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108971:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108977:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108983:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108989:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.108994:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109000:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109006:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109012:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109018:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109024:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109030:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109036:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109042:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109046:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109052:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109057:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109062:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109068:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109073:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109078:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109083:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109088:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109095:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109101:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109107:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109113:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109118:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109132:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109138:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109145:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109151:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109157:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109162:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109167:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109173:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109179:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109184:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109190:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109196:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109202:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109207:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109213:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109219:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109225:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109230:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109235:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109365:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109375:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109380:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109386:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109392:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109398:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.109413:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784045484.110914:0:8422:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff939cc104a000:8422] 0 exiting: rc = 1 00000100:00100000:3.0:1784045484.111287:0:8423:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff939cc104bc00:8423] 1 exiting: rc = 0 00000100:00100000:0.0:1784045484.111702:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111713:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111720:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111726:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111734:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111741:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111747:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111752:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111759:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111782:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111790:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111797:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111819:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111827:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111834:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111840:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111847:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111853:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111870:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111877:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111885:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111891:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111898:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111907:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111931:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111939:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111946:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111954:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111961:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111967:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111973:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111980:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111986:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.111993:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112000:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112006:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112027:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112035:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112041:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112049:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112057:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112064:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112071:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112078:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112092:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112099:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112105:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112111:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112134:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112141:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112148:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112155:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112162:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112168:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112174:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112180:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112188:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112194:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112201:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112207:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112230:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112239:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112250:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784045484.112257:0:15786:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1784045484.127080:0:15786:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1784045506.351943:0:16551:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784045519.638868:0:17151:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784045519.638874:0:17151:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784045519.638876:0:17151:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784045519.639005:0:17151:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff939b840c4000 00000020:01000004:2.0:1784045519.639022:0:17151:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784045519.639030:0:17151:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784045519.639043:0:17151:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff939c9fdd99c0) 00000020:00000080:2.0:1784045519.639058:0:17151:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784045519.781173:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1784045519.781997:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784045519.790955:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1784045519.792128:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784045519.792627:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1784045519.792888:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1784045519.793539:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1784045519.794240:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784045519.799362:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784045519.801184:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784045519.801753:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1784045519.802210:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1784045519.802497:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1784045519.802732:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1784045519.803149:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784045519.803562:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784045519.808287:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1784045519.812207:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1784045519.813490:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1784045519.815391:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1784045519.816236:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1784045519.817746:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784045519.818337:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1784045519.818719:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1784045519.820533:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784045519.821159:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1784045519.823221:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1784045519.823690:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1784045519.824341:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1784045519.824706:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1784045519.824953:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1784045519.825573:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1784045519.826188:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1784045519.828695:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1784045519.829389:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1784045519.838562:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784045519.839134:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784045519.839498:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1784045519.839721:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1784045519.840247:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1784045519.843515:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1784045519.844103:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1784045519.845162:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1784045519.845687:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1784045519.846051:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1784045519.846754:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1784045519.847196:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1784045519.855115:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1784045519.856718:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1784045519.856965:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1784045519.857601:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1784045519.857806:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1784045519.858093:0:17151:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1784045519.863791:0:17151:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784045519.864039:0:17151:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784045519.864048:0:17151:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784045519.864058:0:17151:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454d697 00000020:01000004:1.0:1784045519.864064:0:17151:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1784045519.864069:0:17151:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784045519.864073:0:17151:0:(tgt_mount.c:101:server_register_mount()) register mount ffff939b840c4000 from MGS 00000020:01000004:1.0:1784045519.864077:0:17151:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784045519.864086:0:17151:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff939cc13a19c0) 00000020:00000080:1.0:1784045519.864095:0:17151:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1784045519.864148:0:17151:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939b840c4000 from MGS, refs=2 00080000:01000000:1.0:1784045519.864152:0:17151:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784045519.864156:0:17151:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454d6a5 00000100:00100000:1.0:1784045519.864238:0:17151:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1784045519.864599:0:17151:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1784045519.864607:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1784045519.865475:0:17151:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1784045519.865491:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1784045519.866103:0:17151:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784045519.866250:0:17151:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1784045519.866256:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1784045519.871738:0:17151:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1784045519.871760:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1784045519.881182:0:17151:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1784045519.881202:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784045519.882613:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045519.882617:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045519.882619:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045519.882904:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045519.882907:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045519.882908:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045519.883743:0:17151:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784045519.900797:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1784045519.905849:0:17151:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1784045519.915858:0:17163:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784045519.915927:0:17151:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784045519.915971:0:17151:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784045519.916770:0:17151:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784045519.917079:0:17151:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045519.917212:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784045519.917218:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784045519.923787:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784045519.923801:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1784045519.932561:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1784045519.932573:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784045519.933786:0:17151:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784045519.933807:0:17151:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.144@tcp' 00000020:01000004:3.0:1784045519.933809:0:17151:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1784045519.933838:0:17151:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.144@tcp (typ=mgc) 00000020:00000080:3.0:1784045519.933849:0:17151:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.144@tcp (ffff939b832619c0) 00000020:00000080:3.0:1784045519.933864:0:17151:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1784045519.933963:0:17151:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939c873ce800@MGC192.168.203.144@tcp: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1784045519.934105:0:17151:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.144@tcp-0 is initialized 00000040:01000000:3.0:1784045519.934111:0:17151:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 1 is initialized 00000100:00080000:2.0:1784045519.934707:0:17168:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1784045519.937546:0:17169:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1784045519.938500:0:17151:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.144@tcp (uuid c25407c2-0928-423d-881e-1585e6e3cc3c) 00000020:00000080:3.0:1784045519.938532:0:17151:0:(genops.c:1406:class_connect()) connect: client c25407c2-0928-423d-881e-1585e6e3cc3c, cookie 0x5475624df454d6b3 00000100:00080000:3.0:1784045519.938543:0:17151:0:(import.c:510:import_select_connection()) MGC192.168.203.144@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784045519.938549:0:17151:0:(import.c:624:import_select_connection()) MGC192.168.203.144@tcp: import ffff939c873ce800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045519.938581:0:17151:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82881c00 x1870706873904768/t0(0) o250->MGC192.168.203.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045519.938613:0:17151:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c25407c2-0928-423d-881e-1585e6e3cc3c->MGS 00000020:01000004:3.0:1784045519.938643:0:17151:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1784045519.938649:0:17151:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1784045519.938663:0:17151:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff939b83260000) 00000020:00000080:3.0:1784045519.938676:0:17151:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1784045519.940555:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c25407c2-0928-423d-881e-1585e6e3cc3c:3622:1870706873904768:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784045519.940645:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045519.945879:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873904768 00000100:00100000:2.0:1784045519.945907:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873904768 00000100:00100000:2.0:1784045519.948728:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045519.948741:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3622:x1870706873904768:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1784045519.948774:0:17166:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c25407c2-0928-423d-881e-1585e6e3cc3c@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:2.0:1784045519.948811:0:17166:0:(genops.c:1406:class_connect()) connect: client c25407c2-0928-423d-881e-1585e6e3cc3c, cookie 0x5475624df454d6c1 00000100:00080000:2.0:1784045519.948955:0:17166:0:(import.c:65:import_set_state_nolock()) ffff939c921d0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045519.949056:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+5:3622:x1870706873904768:12345-0@lo:250:mount.lustre.0 Request processed in 315us (8420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045519.949064:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045519.949122:0:3622:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.144@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1784045519.949131:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.144@tcp: connect to target with instance 0 00000100:00080000:2.0:1784045519.949138:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.144@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784045519.949143:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784045519.949146:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c873ce800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784045519.949149:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784045519.949157:0:3622:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784045519.949162:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c25407c2-0928-423d-881e-1585e6e3cc3c:3622:1870706873904768:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1784045519.966742:0:17151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784045519.966930:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1784045519.966937:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1784045519.969189:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1784045519.969202:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1784045519.969872:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1784045519.969879:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1784045519.971039:0:17151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784045519.971193:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1784045519.971198:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1784045519.971897:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1784045519.971905:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1784045520.062189:0:17151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045520.062364:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1784045520.062372:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1784045520.066281:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1784045520.066295:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1784045520.069818:0:17151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045520.070168:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784045520.070175:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1784045520.075833:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784045520.075853:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1784045520.089800:0:17151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045520.089970:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784045520.089976:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784045520.090815:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784045520.090823:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784045520.091320:0:17151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784045520.091495:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784045520.091499:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784045520.092070:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784045520.092076:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784045520.123830:0:17151:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784045520.124117:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784045520.124125:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784045520.134088:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784045520.134302:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1784045520.135284:0:17151:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784045520.135293:0:17151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1784045520.140305:0:17151:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1784045520.140345:0:17151:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1784045520.140351:0:17151:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1784045520.140490:0:17151:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784045520.140532:0:17151:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.144@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1784045520.140536:0:17151:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784045520.140537:0:17151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784045520.140538:0:17151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045520.140539:0:17151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045520.140541:0:17151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045520.140542:0:17151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045520.140543:0:17151:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045520.140544:0:17151:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784045520.140546:0:17151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045520.140547:0:17151:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784045520.140549:0:17151:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1784045520.140551:0:17151:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784045520.140552:0:17151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784045520.140554:0:17151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045520.140555:0:17151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045520.140556:0:17151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045520.140557:0:17151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045520.140558:0:17151:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045520.140559:0:17151:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784045520.140565:0:17151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045520.140565:0:17151:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784045520.140591:0:17151:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784045520.140610:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873904896:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784045520.140695:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045520.140763:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c873eef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045520.141048:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873904896 00000100:00100000:3.0:1784045520.141055:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873904896 00000100:00100000:3.0:1784045520.141098:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045520.141106:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+5:17151:x1870706873904896:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784045520.141147:0:17167:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784045520.141150:0:17167:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784045520.141153:0:17167:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1784045520.141855:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1784045520.149158:0:17167:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1784045520.153188:0:17189:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1784045520.153195:0:17189:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1784045520.153198:0:17189:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1784045520.153210:0:17189:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1784045520.153537:0:17189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1784045520.153714:0:17167:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784045520.153725:0:17167:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784045520.159330:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+5:17151:x1870706873904896:12345-0@lo:253:mount.lustre.0 Request processed in 18217us (18627us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045520.159342:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784045520.159433:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873904896:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784045520.159468:0:17151:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784045520.159472:0:17151:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784045520.159473:0:17151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784045520.159475:0:17151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045520.159476:0:17151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045520.159477:0:17151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045520.159478:0:17151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045520.159479:0:17151:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045520.159480:0:17151:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784045520.159482:0:17151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045520.159484:0:17151:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784045520.159503:0:17151:0:(tgt_mount.c:101:server_register_mount()) register mount ffff939b840c4000 from lustre-MDT0000 10000000:01000000:0.0:1784045520.159533:0:17151:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784045520.159536:0:17151:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784045520.159541:0:17151:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff939b832619c0 10000000:01000000:0.0:1784045520.159544:0:17151:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784045520.159554:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff939b832619c0 from 1 10000000:01000000:0.0:1784045520.159557:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784045520.159589:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.159599:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.159608:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045520.159652:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873905024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784045520.159687:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045520.159727:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c873ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1784045520.159780:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873905024 00000100:00100000:2.0:1784045520.159785:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873905024 00000100:00100000:2.0:1784045520.159827:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045520.159835:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+5:17151:x1870706873905024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045520.159847:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045520.159861:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81986800/0x5475624df454d6cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d6c8 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045520.159882:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986800/0x5475624df454d6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d6c8 expref: 6 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045520.159903:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81986800/0x5475624df454d6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d6c8 expref: 6 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045520.159912:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986800, rc 0) 00000100:00100000:2.0:1784045520.159960:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+6:17151:x1870706873905024:12345-0@lo:101:mount.lustre.0 Request processed in 126us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045520.159966:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045520.160147:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873905024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045520.160159:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6cf expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.160167:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d6cf expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045520.160212:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873905152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045520.160235:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045520.160246:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c873ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1784045520.160349:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873905152 00000100:00100000:2.0:1784045520.160360:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873905152 00000100:00100000:2.0:1784045520.160391:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045520.160398:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+6:17151:x1870706873905152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045520.160497:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+6:17151:x1870706873905152:12345-0@lo:501:mount.lustre.0 Request processed in 99us (260us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045520.160503:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045520.160598:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873905152:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1784045520.160623:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784045520.160646:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6cf expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.160655:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6cf expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045520.160662:0:17151:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff939b840c4000 10000000:01000000:0.0:1784045520.160666:0:17151:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784045520.160669:0:17151:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff939b840c4000 10000000:01000000:0.0:1784045520.160671:0:17151:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784045520.160674:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff939b840c4000 from 1 10000000:01000000:0.0:1784045520.160681:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784045520.160698:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2400/0x5475624df454d6d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.160706:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c918b2400/0x5475624df454d6d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.160713:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c918b2400/0x5475624df454d6d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045520.160726:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873905280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784045520.160750:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045520.160777:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c873ee900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045520.160877:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873905280 00000100:00100000:3.0:1784045520.160883:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873905280 00000100:00100000:3.0:1784045520.160922:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784045520.160930:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+6:17151:x1870706873905280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045520.160938:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045520.160950:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c93633400/0x5475624df454d6dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d6d6 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.160965:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c93633400/0x5475624df454d6dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d6d6 expref: 7 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.160975:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c93633400/0x5475624df454d6dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d6d6 expref: 7 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.160982:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93633400, rc 0) 00000100:00100000:3.0:1784045520.161012:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+7:17151:x1870706873905280:12345-0@lo:101:mount.lustre.0 Request processed in 83us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045520.161019:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045520.161091:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873905280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045520.161103:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c918b2400/0x5475624df454d6d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6dd expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.161111:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c918b2400/0x5475624df454d6d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d6dd expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045520.161123:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784045520.161126:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2400/0x5475624df454d6d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6dd expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.161132:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c918b2400/0x5475624df454d6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6dd expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045520.161138:0:17151:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784045520.161141:0:17151:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784045520.161151:0:17151:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff939b840c4000 10000000:01000000:0.0:1784045520.161154:0:17151:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784045520.161158:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784045520.161160:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784045520.161177:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b3600/0x5475624df454d6e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.161184:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c918b3600/0x5475624df454d6e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.161191:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c918b3600/0x5475624df454d6e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045520.161202:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873905408:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784045520.161228:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045520.161260:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c873ee900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045520.161416:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873905408 00000100:00100000:3.0:1784045520.161421:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873905408 00000100:00100000:3.0:1784045520.161476:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784045520.161483:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+7:17151:x1870706873905408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045520.161490:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045520.161497:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c93632400/0x5475624df454d6eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d6e4 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.161519:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c93632400/0x5475624df454d6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d6e4 expref: 8 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.161527:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c93632400/0x5475624df454d6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d6e4 expref: 8 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.161534:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93632400, rc 0) 00000100:00100000:3.0:1784045520.161565:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+8:17151:x1870706873905408:12345-0@lo:101:mount.lustre.0 Request processed in 84us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045520.161571:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045520.162488:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873905408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045520.162505:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c918b3600/0x5475624df454d6e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6eb expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.162514:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c918b3600/0x5475624df454d6e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d6eb expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045520.162585:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873905536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045520.162623:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045520.162669:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c873ee900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045520.162750:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873905536 00000100:00100000:3.0:1784045520.162755:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873905536 00000100:00100000:3.0:1784045520.162797:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045520.162805:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+8:17151:x1870706873905536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045520.162946:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+9:17151:x1870706873905536:12345-0@lo:501:mount.lustre.0 Request processed in 142us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045520.162953:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045520.163070:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873905536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045520.163118:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873905664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784045520.163157:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045520.163598:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c873ee900 going to sleep for 11 seconds 00000100:00100000:2.0:1784045520.163912:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873905664 00000100:00100000:2.0:1784045520.163918:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873905664 00000100:00100000:2.0:1784045520.163962:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784045520.163970:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+9:17151:x1870706873905664:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045520.164825:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+9:17151:x1870706873905664:12345-0@lo:503:mount.lustre.0 Request processed in 853us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045520.164835:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784045520.165580:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873905664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045520.167479:0:17190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17190:1870706873905792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045520.167553:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045520.167607:0:17190:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c000 going to sleep for 11 seconds 00000100:00100000:3.0:1784045520.167685:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873905792 00000100:00100000:3.0:1784045520.167692:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873905792 00000100:00100000:3.0:1784045520.167742:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045520.167752:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+9:17190:x1870706873905792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045520.168502:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+9:17190:x1870706873905792:12345-0@lo:502:llog_process_th.0 Request processed in 750us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045520.168512:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784045520.168568:0:17190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17190:1870706873905792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784045520.168597:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045520.168607:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045520.168610:0:17190:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784045520.168614:0:17190:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784045520.168617:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045520.168641:0:17190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff939c9fddcd40) 00000020:00000080:2.0:1784045520.168657:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1784045520.168662:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784045520.168742:0:17190:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784045520.168749:0:17190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454d6f9 00000020:00000080:2.0:1784045520.168968:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784045520.168978:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045520.168981:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045520.168983:0:17190:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784045520.168985:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045520.168988:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045520.168990:0:17190:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784045520.168993:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045520.169000:0:17190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff939c9fdd8000) 00000020:00000080:2.0:1784045520.169010:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1784045520.169013:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784045520.169015:0:17190:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784045520.169018:0:17190:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784045520.169024:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784045520.169069:0:17190:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939b840c4000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784045520.169082:0:17190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff939c9fddb380) 00000020:00000080:2.0:1784045520.169089:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1784045520.169131:0:17190:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784045520.169136:0:17190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454d70e 00000020:00000080:2.0:1784045520.169222:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784045520.169228:0:17190:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784045520.169232:0:17190:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5475624df454d715 00080000:01000000:2.0:1784045520.169237:0:17190:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784045520.169240:0:17190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454d71c 00010000:00010000:0.0:1784045520.306339:0:17190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1784045520.307032:0:17190:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:0.0:1784045520.307325:0:17190:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1784045520.307919:0:17190:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff939cb59d19c0) 00000020:00000080:0.0:1784045520.307938:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1784045520.308016:0:17190:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1784045520.308024:0:17190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454d72a 00000020:00000080:0.0:1784045520.318662:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784045520.337177:0:17190:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5475624df454d731 00000020:00000080:3.0:1784045520.340613:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784045520.340628:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045520.340660:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045520.340663:0:17190:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784045520.340667:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784045520.340670:0:17190:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1784045520.340671:0:17190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784045520.340673:0:17190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784045520.340675:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784045520.340677:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045520.340678:0:17190:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784045520.340680:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045520.340685:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045520.340687:0:17190:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784045520.340691:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784045520.340742:0:17190:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784045520.340759:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045520.340762:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045520.340764:0:17190:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1784045520.340766:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045520.340769:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045520.340771:0:17190:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1784045520.340774:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784045520.340779:0:17190:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:00000080:3.0:1784045520.340804:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784045520.340822:0:17190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff939b83264d40) 00000020:00000080:3.0:1784045520.340840:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1784045520.340844:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784045520.341613:0:17190:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1784045520.341621:0:17190:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784045520.341628:0:17190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454d73f 00010000:00080000:3.0:1784045520.341672:0:17190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939c937bd800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1784045520.348233:0:17190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1784045520.353799:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784045520.353815:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1784045520.353856:0:17190:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784045520.353875:0:17190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454d746 00000100:00080000:0.0:1784045520.353886:0:17190:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784045520.353904:0:17190:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff939c937bd800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045520.353947:0:17190:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939c91562680 x1870706873905920/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784045520.353972:0:17190:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1784045520.354028:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045520.354031:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045520.354033:0:17190:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1784045520.354036:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784045520.354038:0:17190:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1784045520.354040:0:17190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784045520.354041:0:17190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784045520.354043:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784045520.354060:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045520.354061:0:17190:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784045520.354064:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784045520.354069:0:17190:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784045520.354072:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045520.354073:0:17190:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784045520.354076:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784045520.354079:0:17190:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:0.0:1784045520.354103:0:17190:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784045520.354106:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784045520.354119:0:17190:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff939cb59d3380) 00000020:00000080:0.0:1784045520.354130:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1784045520.354134:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784045520.354203:0:17190:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1784045520.354209:0:17190:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1784045520.354215:0:17190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454d754 00010000:00080000:0.0:1784045520.354247:0:17190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939c937be000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:0.0:1784045520.354605:0:17190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1784045520.355590:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873905920:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784045520.355666:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045520.355730:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873905920 00000100:00100000:2.0:1784045520.355736:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873905920 00000100:00100000:2.0:1784045520.355762:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045520.355768:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1870706873905920:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1784045520.355784:0:17177:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1784045520.357200:0:17190:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784045520.361779:0:17190:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784045520.365966:0:17190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045520.366435:0:17190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1784045520.373253:0:17190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1784045520.380547:0:17196:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784045520.380554:0:17196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784045520.381297:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784045520.381309:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784045520.381357:0:17190:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784045520.381376:0:17190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454d75b 00000100:00080000:0.0:1784045520.381387:0:17190:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784045520.381392:0:17190:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939c937be000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045520.381428:0:17190:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939c91562a00 x1870706873906048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784045520.381500:0:17190:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784045520.381548:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045520.381552:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045520.381555:0:17190:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784045520.381557:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784045520.381560:0:17190:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1784045520.381562:0:17190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784045520.381564:0:17190:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784045520.381565:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784045520.381568:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045520.381570:0:17190:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784045520.381572:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784045520.381577:0:17190:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784045520.381581:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045520.381582:0:17190:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784045520.381585:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784045520.381589:0:17190:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:0.0:1784045520.381614:0:17190:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784045520.381617:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784045520.381628:0:17190:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff939cb59d4d40) 00000020:00000080:0.0:1784045520.381652:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1784045520.381658:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784045520.381709:0:17190:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784045520.381715:0:17190:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:0.0:1784045520.381719:0:17190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5475624df454d769 00010000:00080000:0.0:1784045520.381749:0:17190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939cb5a99000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:0.0:1784045520.381937:0:17190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1784045520.382013:0:17190:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784045520.382027:0:17190:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1784045520.382864:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873906048:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1784045520.382929:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706873906048 offset 0 length 520: 4 00000040:00080000:1.0:1784045520.396579:0:17190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045520.397348:0:17190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1784045520.397586:0:17190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1784045520.398128:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1870706873905920:12345-0@lo:38:llog_process_th.0 Request processed in 42349us (42452us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784045520.398152:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1784045520.398241:0:17198:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784045520.398247:0:17198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00080000:0.0:1784045520.398485:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c937bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784045520.398499:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784045520.398515:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873905920:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1784045520.399285:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784045520.399298:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784045520.399343:0:17190:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784045520.399365:0:17190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454d770 00000100:00080000:0.0:1784045520.399374:0:17190:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784045520.399380:0:17190:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939cb5a99000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045520.399414:0:17190:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939c91562680 x1870706873906176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784045520.399441:0:17190:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784045520.399536:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045520.399540:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045520.399542:0:17190:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784045520.399545:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045520.399550:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045520.399551:0:17190:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784045520.399554:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784045520.399556:0:17190:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784045520.399559:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045520.399561:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045520.399562:0:17190:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784045520.399565:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045520.399568:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045520.399569:0:17190:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784045520.399572:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784045520.399604:0:17190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17190:1870706873906304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045520.399702:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045520.399704:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873906176:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1784045520.399738:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706873906176 offset 0 length 520: 4 00000100:00100000:0.0:1784045520.399743:0:17190:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784045520.399801:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873906304 00000100:00100000:2.0:1784045520.399809:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873906304 00000100:00100000:2.0:1784045520.399907:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045520.399918:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+9:17190:x1870706873906304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045520.400053:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+9:17190:x1870706873906304:12345-0@lo:502:llog_process_th.0 Request processed in 136us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045520.400061:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784045520.400080:0:17190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17190:1870706873906304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784045520.400114:0:17190:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045520.400119:0:17190:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045520.400121:0:17190:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784045520.400125:0:17190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1784045520.400283:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1784045520.400303:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784045520.400323:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b3600/0x5475624df454d6e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6eb expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045520.400332:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c918b3600/0x5475624df454d6e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6eb expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045520.400339:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939b840c4000 from 1 10000000:01000000:2.0:1784045520.400341:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784045520.400369:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045520.400375:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045520.400382:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045520.400392:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873906432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784045520.400423:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045520.400481:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873906432 00000100:00100000:3.0:1784045520.400487:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873906432 00000100:00100000:3.0:1784045520.400517:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784045520.400525:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+9:17151:x1870706873906432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045520.400536:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1784045520.400544:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784045520.400552:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c93632800/0x5475624df454d77e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d777 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.400578:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c93632800/0x5475624df454d77e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d777 expref: 10 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.400590:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c93632800/0x5475624df454d77e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d777 expref: 10 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.400601:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93632800, rc 0) 00000100:00100000:3.0:1784045520.400642:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+10:17151:x1870706873906432:12345-0@lo:101:mount.lustre.0 Request processed in 106us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045520.400649:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784045520.400664:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873906432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045520.400678:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d77e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045520.400688:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d77e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045520.401223:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873906560:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1784045520.401266:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045520.401490:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045520.401575:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873906560 00000100:00100000:3.0:1784045520.401582:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873906560 00000100:00100000:3.0:1784045520.401625:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784045520.401643:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+10:17151:x1870706873906560:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784045520.401662:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784045520.401677:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1784045520.401771:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+10:17151:x1870706873906560:12345-0@lo:256:mount.lustre.0 Request processed in 139us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045520.401779:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784045520.401892:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873906560:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1784045520.402435:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784045520.402473:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d77e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045520.402482:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d77e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045520.402488:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939b840c4000 from 1 10000000:01000000:2.0:1784045520.402493:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784045520.402520:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045520.402527:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045520.403952:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045520.404060:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873906688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784045520.404169:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045520.404221:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885d6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045520.404606:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873906688 00000100:00100000:2.0:1784045520.404617:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873906688 00000100:00100000:2.0:1784045520.404688:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045520.404700:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+10:17151:x1870706873906688:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045520.404716:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045520.404735:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81986e00/0x5475624df454d78c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d785 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045520.404761:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986e00/0x5475624df454d78c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d785 expref: 11 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045520.404778:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81986e00/0x5475624df454d78c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d785 expref: 11 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045520.404787:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986e00, rc 0) 00000100:00100000:2.0:1784045520.404872:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+11:17151:x1870706873906688:12345-0@lo:101:mount.lustre.0 Request processed in 175us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045520.404880:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784045520.405143:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873906688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045520.405162:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d78c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.405172:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d78c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045520.405251:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873906816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045520.405283:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045520.405319:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885d6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045520.406503:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873906816 00000100:00100000:2.0:1784045520.406514:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873906816 00000100:00100000:2.0:1784045520.406571:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045520.406580:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+11:17151:x1870706873906816:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045520.406763:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+11:17151:x1870706873906816:12345-0@lo:501:mount.lustre.0 Request processed in 184us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045520.406789:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784045520.406945:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873906816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045520.407000:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873906944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784045520.407043:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045520.407079:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885d6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045520.407123:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873906944 00000100:00100000:0.0:1784045520.407127:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873906944 00000100:00100000:0.0:1784045520.407158:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045520.407166:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+11:17151:x1870706873906944:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784045520.407249:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+11:17151:x1870706873906944:12345-0@lo:503:mount.lustre.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045520.407257:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045520.407295:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873906944:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784045520.407520:0:17200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17200:1870706873907072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045520.407553:0:17200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045520.407572:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873907072 00000100:00100000:0.0:1784045520.407575:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873907072 00000100:00100000:0.0:1784045520.407592:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784045520.407597:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+11:17200:x1870706873907072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784045520.407747:0:17200:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9777ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045520.410013:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+11:17200:x1870706873907072:12345-0@lo:502:llog_process_th.0 Request processed in 2408us (2452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045520.410027:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784045520.410748:0:17200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17200:1870706873907072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784045520.410803:0:17200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045520.410812:0:17200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045520.410815:0:17200:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784045520.410821:0:17200:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939b840c4000 00000020:00000080:1.0:1784045520.410824:0:17200:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784045520.410831:0:17200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045520.410834:0:17200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045520.410835:0:17200:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784045520.410837:0:17200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045520.410840:0:17200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045520.410841:0:17200:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784045520.410844:0:17200:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939b840c4000 00000020:00000080:1.0:1784045520.410846:0:17200:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784045520.411436:0:17200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045520.411479:0:17200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045520.411482:0:17200:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1784045520.411485:0:17200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045520.411488:0:17200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045520.411490:0:17200:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784045520.411493:0:17200:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939b840c4000 00000020:00000080:1.0:1784045520.411495:0:17200:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784045520.411520:0:17200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045520.411523:0:17200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045520.411524:0:17200:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784045520.411526:0:17200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045520.411528:0:17200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045520.411529:0:17200:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1784045520.411532:0:17200:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939b840c4000 00000020:00000080:1.0:1784045520.411534:0:17200:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784045520.411582:0:17200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17200:1870706873907200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045520.411659:0:17200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045520.411704:0:17200:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c939d0000 going to sleep for 11 seconds 00000100:00100000:3.0:1784045520.411826:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873907200 00000100:00100000:3.0:1784045520.411832:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873907200 00000100:00100000:3.0:1784045520.411879:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784045520.411898:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+11:17200:x1870706873907200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784045520.412034:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+11:17200:x1870706873907200:12345-0@lo:502:llog_process_th.0 Request processed in 146us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045520.412046:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784045520.412127:0:17200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17200:1870706873907200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784045520.412148:0:17200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045520.412154:0:17200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045520.412159:0:17200:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784045520.412165:0:17200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1784045520.412563:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1784045520.412586:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045520.412606:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d78c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.412618:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d78c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045520.412674:0:17151:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784045520.412677:0:17151:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff939b840c4000 10000000:01000000:3.0:1784045520.412680:0:17151:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff939b840c4000 10000000:01000000:3.0:1784045520.412683:0:17151:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784045520.412689:0:17151:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939b840c4000 from 1 10000000:01000000:3.0:1784045520.412691:0:17151:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784045520.412717:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93632600/0x5475624df454d793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.412725:0:17151:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c93632600/0x5475624df454d793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.412734:0:17151:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c93632600/0x5475624df454d793 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045520.412747:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873907328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784045520.412780:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045520.412812:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885d6240 going to sleep for 11 seconds 00000100:00100000:1.0:1784045520.412911:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873907328 00000100:00100000:1.0:1784045520.412917:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873907328 00000100:00100000:1.0:1784045520.412950:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784045520.412958:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+11:17151:x1870706873907328:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045520.412967:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045520.412979:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b836cd200/0x5475624df454d79a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d793 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045520.412999:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836cd200/0x5475624df454d79a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d793 expref: 12 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045520.413009:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b836cd200/0x5475624df454d79a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d793 expref: 12 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045520.413018:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cd200, rc 0) 00000100:00100000:1.0:1784045520.413132:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17151:x1870706873907328:12345-0@lo:101:mount.lustre.0 Request processed in 175us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045520.413138:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045520.429904:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873907328:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045520.429937:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c93632600/0x5475624df454d793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d79a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.429952:0:17151:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c93632600/0x5475624df454d793 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d79a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045520.430082:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873907456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045520.430129:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045520.430173:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9777ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1784045520.431251:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873907456 00000100:00100000:1.0:1784045520.431260:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873907456 00000100:00100000:1.0:1784045520.431320:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784045520.431396:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17151:x1870706873907456:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045520.431590:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17151:x1870706873907456:12345-0@lo:501:mount.lustre.0 Request processed in 260us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045520.431599:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784045520.431606:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873907456:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045520.431663:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873907584:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784045520.431707:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045520.431736:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9777ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045520.431753:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873907584 00000100:00100000:0.0:1784045520.431757:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873907584 00000100:00100000:0.0:1784045520.431778:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784045520.431784:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17151:x1870706873907584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784045520.431863:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17151:x1870706873907584:12345-0@lo:503:mount.lustre.0 Request processed in 77us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045520.431871:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784045520.431918:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873907584:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045520.435218:0:17205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17205:1870706873907712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045520.435293:0:17205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045520.435349:0:17205:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700840 going to sleep for 11 seconds 00000100:00100000:1.0:1784045520.435480:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873907712 00000100:00100000:1.0:1784045520.435488:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873907712 00000100:00100000:1.0:1784045520.435533:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784045520.435542:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17205:x1870706873907712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784045520.435680:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17205:x1870706873907712:12345-0@lo:502:llog_process_th.0 Request processed in 139us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045520.435688:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784045520.438136:0:17205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17205:1870706873907712:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1784045520.438214:0:17205:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784045520.438230:0:17205:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff939cb58b4d40) 00000020:00000080:2.0:1784045520.438252:0:17205:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1784045520.438533:0:17205:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939b840c4000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784045520.438538:0:17205:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939b840c4000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784045520.438541:0:17205:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939b840c4000 4 00010000:00080000:2.0:1784045520.438577:0:17205:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939b82a1e800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.144@tcp at head 00010000:00010000:2.0:1784045520.447847:0:17205:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1784045520.447968:0:17205:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1784045520.448011:0:17205:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784045520.448024:0:17205:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5475624df454d7a8 00000100:00080000:2.0:1784045520.448034:0:17205:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784045520.448040:0:17205:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff939b82a1e800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045520.448075:0:17205:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939cbf4cf800 x1870706873907840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045520.448106:0:17205:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784045520.448478:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1870706873907840:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784045520.448552:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045520.451832:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873907840 00000100:00100000:3.0:1784045520.451845:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873907840 00000100:00100000:3.0:1784045520.451905:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045520.451913:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873907840:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784045520.452014:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873907840:12345-0@lo:38:llog_process_th.0 Request processed in 100us (3461us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784045520.452022:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045520.452063:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784045520.452072:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b82a1e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045520.452076:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784045520.452080:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1870706873907840:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784045520.463382:0:17205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17205:1870706873907968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045520.463483:0:17205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045520.463541:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873907968 00000100:00100000:2.0:1784045520.463547:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873907968 00000100:00100000:2.0:1784045520.463593:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784045520.463607:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17205:x1870706873907968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045520.463721:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17205:x1870706873907968:12345-0@lo:502:llog_process_th.0 Request processed in 115us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045520.463729:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784045520.463783:0:17205:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700840 going to sleep for 11 seconds 00000100:00100000:2.0:1784045520.463801:0:17205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17205:1870706873907968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045520.463835:0:17205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17205:1870706873908096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045520.463864:0:17205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045520.463881:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873908096 00000100:00100000:2.0:1784045520.463884:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873908096 00000100:00100000:2.0:1784045520.463902:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784045520.463907:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17205:x1870706873908096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784045520.463957:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17205:x1870706873908096:12345-0@lo:502:llog_process_th.0 Request processed in 49us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045520.463964:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784045520.463986:0:17205:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700840 going to sleep for 11 seconds 00000100:00100000:2.0:1784045520.463996:0:17205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c25407c2-0928-423d-881e-1585e6e3cc3c:17205:1870706873908096:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784045520.464010:0:17205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784045520.466019:0:17151:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784045520.466059:0:17151:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784045520.466092:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93632600/0x5475624df454d793 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d79a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.466105:0:17151:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c93632600/0x5475624df454d793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d79a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784045520.466170:0:17151:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784045520.466173:0:17151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784045520.466174:0:17151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045520.466176:0:17151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045520.466178:0:17151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045520.466179:0:17151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045520.466180:0:17151:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045520.466182:0:17151:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784045520.466183:0:17151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045520.466185:0:17151:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784045520.466188:0:17151:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784045520.466191:0:17151:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784045520.466192:0:17151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784045520.466193:0:17151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045520.466194:0:17151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045520.466195:0:17151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045520.466197:0:17151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045520.466198:0:17151:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045520.466199:0:17151:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784045520.466200:0:17151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045520.466201:0:17151:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784045520.466225:0:17151:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784045520.466242:0:17151:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873908224:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784045520.466305:0:17151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045520.466355:0:17151:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8831e540 going to sleep for 11 seconds 00000100:00100000:2.0:1784045520.466497:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873908224 00000100:00100000:2.0:1784045520.466506:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873908224 00000100:00100000:2.0:1784045520.466553:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784045520.466563:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17151:x1870706873908224:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784045520.466589:0:17167:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784045520.466603:0:17167:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784045520.470833:0:17167:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784045520.470909:0:17167:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1784045520.474260:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17151:x1870706873908224:12345-0@lo:253:mount.lustre.0 Request processed in 7691us (7947us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045520.474277:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784045520.474358:0:17151:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17151:1870706873908224:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784045520.474373:0:17151:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784045520.474376:0:17151:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784045520.474378:0:17151:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784045520.474379:0:17151:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045520.474380:0:17151:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045520.474381:0:17151:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045520.474383:0:17151:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045520.474384:0:17151:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784045520.474386:0:17151:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784045520.474388:0:17151:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045520.474389:0:17151:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784045520.474405:0:17151:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1784045520.475541:0:17188:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784045520.475558:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784045520.475578:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.475594:0:17188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c93632800/0x5475624df454d77e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d777 expref: 11 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.475602:0:17188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.475650:0:17188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c93632800/0x5475624df454d77e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454d777 expref: 11 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.475666:0:17188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939c93632800/0x5475624df454d77e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454d777 expref: 11 pid: 17167 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045520.475679:0:17188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873908352:0@lo:104: 00000100:00100000:0.0:1784045520.475726:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045520.475771:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9fd81a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784045520.483834:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873908352 00000100:00100000:3.0:1784045520.483847:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873908352 00000100:00100000:3.0:1784045520.490274:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045520.490301:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+3:17188:x1870706873908352:12345-0@lo:104: 00010000:00010000:3.0:1784045520.490320:0:17155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d77e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.490428:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784045520.490435:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+3:17188:x1870706873908352:12345-0@lo:104: Request processed in 149us (14708us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045520.490458:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1784045520.490490:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045520.490497:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d77e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.490505:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987800 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:3.0:1784045520.490509:0:17161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454d77e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.490540:0:17161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454d77e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045520.490547:0:17161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454d77e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045520.490553:0:17161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784045520.490587:0:17161:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d77e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.490594:0:17161:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784045520.490625:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d77e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.490642:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454d777 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d77e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045520.490666:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045520.490668:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045520.490669:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045520.490723:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873908480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045520.490760:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045520.491070:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873908480 00000100:00100000:0.0:1784045520.491078:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873908480 00010000:00010000:0.0:1784045520.491106:0:17157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c93632800/0x5475624df454d77e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d777 expref: 12 pid: 17167 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045520.491138:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784045520.491145:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+12:3623:x1870706873908480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045520.491157:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045520.491162:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c93632800/0x5475624df454d77e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d777 expref: 12 pid: 17167 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.491173:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c93632800/0x5475624df454d77e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454d777 expref: 12 pid: 17167 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.491197:0:17157:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.491205:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784045520.491221:0:17157:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015662686s 00010000:00010000:0.0:1784045520.491225:0:17157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.491232:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.491240:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.491247:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.491253:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3e00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:0.0:1784045520.491257:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.491264:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.491273:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.491282:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045520.491323:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+12:3623:x1870706873908480:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045520.491336:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784045520.491387:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873908480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045520.491417:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c93632800/0x5475624df454d77e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454d777 expref: 11 pid: 17167 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045520.491428:0:17188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873908352:0@lo:104: 00010000:00010000:0.0:1784045520.491464:0:17188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.491473:0:17188:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.491480:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045520.491486:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c918b3e00/0x5475624df454d7af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784045520.518551:0:17151:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1784045520.522805:0:17151:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1784045520.530184:0:17213:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784045520.530521:0:17151:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1784045520.531025:0:17213:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1784045520.533264:0:17214:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff939c91563480 x1870706873908608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045520.533278:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00000040:01000000:2.0:1784045520.533826:0:17151:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1784045520.533869:0:17151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1784045520.535067:0:17151:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784045520.535082:0:17151:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784045520.535150:0:17151:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1784045520.536187:0:17212:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1784045520.536194:0:17212:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1784045520.538431:0:17213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784045520.538561:0:17213:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1784045520.539283:0:17151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784045520.539888:0:17151:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784045520.539922:0:17151:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1784045520.550808:0:17151:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1784045520.564216:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1784045520.586579:0:17151:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784045520.586622:0:17151:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb20481cbb988 00100000:10000000:3.0:1784045520.586639:0:17151:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1784045520.587675:0:17151:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784045520.587691:0:17151:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784045520.587709:0:17151:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1784045520.587734:0:17151:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1784045520.594597:0:17151:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784045520.594797:0:17151:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784045520.918091:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784045521.379060:0:17169:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784045521.379067:0:17169:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939b840c4000 from 7 10000000:01000000:1.0:1784045521.379072:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784045521.379128:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045521.379140:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045521.379151:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045521.379177:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873908736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045521.379247:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045521.379492:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873908736 00000100:00100000:3.0:1784045521.379500:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873908736 00000100:00100000:3.0:1784045521.379547:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784045521.379554:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+11:17169:x1870706873908736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045521.379566:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045521.379578:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c93632c00/0x5475624df454d7bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d7b6 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045521.379656:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c93632c00/0x5475624df454d7bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d7b6 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045521.379667:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c93632c00/0x5475624df454d7bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d7b6 expref: 12 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045521.379677:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93632c00, rc 0) 00000100:00100000:3.0:1784045521.379714:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17169:x1870706873908736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045521.379722:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784045521.381234:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c91b93900 going to sleep for 11 seconds 00000100:00100000:1.0:1784045521.381270:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873908736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045521.381303:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d7bd expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045521.381325:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d7bd expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045521.381406:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873908864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784045521.381478:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045521.381518:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c91b93900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045521.381616:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873908864 00000100:00100000:3.0:1784045521.381640:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873908864 00000100:00100000:3.0:1784045521.381695:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784045521.381705:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17169:x1870706873908864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784045521.381733:0:17167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784045521.381751:0:17167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784045521.381754:0:17167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1784045521.381929:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17169:x1870706873908864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045521.381941:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784045521.383066:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873908864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784045521.383128:0:17169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784045521.383137:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d7bd expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045521.383148:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d7bd expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045521.493926:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784045521.557894:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:3.0:1784045521.944417:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784045522.516275:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784045522.579992:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:3.0:1784045522.964681:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045523.605659:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:3.0:1784045523.989436:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045524.628647:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:3.0:1784045525.012618:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784045525.083056:0:17457:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1784045525.651609:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00000100:00080000:3.0:1784045525.656302:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784045525.656309:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784045525.656313:0:37:0:(import.c:65:import_set_state_nolock()) ffff939c937bd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045525.656321:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:3.0:1784045525.656326:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784045525.656333:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff939c937bd800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045525.656356:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82883480 x1870706873909120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045525.656368:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045525.656372:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784045525.656374:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045525.656378:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784045525.656380:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784045525.656383:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784045525.656385:0:37:0:(import.c:65:import_set_state_nolock()) ffff939b82a1e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045525.656389:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff939b82a1e800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045525.656401:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82880e00 x1870706873909248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784045525.656489:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c25407c2-0928-423d-881e-1585e6e3cc3c:3624:1870706873908992:0@lo:400:kworker.0 00000100:00100000:1.0:1784045525.656555:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045525.656781:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873908992 00000100:00100000:3.0:1784045525.656788:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873908992 00000100:00100000:3.0:1784045525.656840:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784045525.656971:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+12:3624:x1870706873908992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045525.657037:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+12:3624:x1870706873908992:12345-0@lo:400:kworker.0 Request processed in 68us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045525.657085:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c25407c2-0928-423d-881e-1585e6e3cc3c:3624:1870706873908992:0@lo:400:kworker.0 00000100:00100000:3.0:1784045525.663413:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784045525.665639:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873909120:0@lo:38:kworker.0 00000100:00100000:0.0:1784045525.665714:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045525.665777:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1870706873909248:0@lo:38:kworker.0 00000100:00100000:0.0:1784045525.665804:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045525.665978:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873909120 00000100:00100000:2.0:1784045525.665991:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873909120 00000100:00100000:2.0:1784045525.666079:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784045525.666086:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1870706873909120:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784045525.666104:0:17178:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784045525.667113:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873909248 00000100:00100000:1.0:1784045525.667121:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873909248 00000100:00100000:1.0:1784045525.667145:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045525.667151:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1870706873909248:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1784045525.667181:0:17174:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:1.0:1784045525.667240:0:17174:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5475624df454d7c4 00000004:00100000:1.0:1784045525.667414:0:17174:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784045525.667656:0:17174:0:(import.c:65:import_set_state_nolock()) ffff939cb58c4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784045525.667770:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1870706873909248:12345-0@lo:38:kworker.0 Request processed in 617us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045525.667778:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784045525.667937:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff939b82880e00 x1870706873909248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784045525.667955:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784045525.667963:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784045525.667968:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784045525.667971:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b82a1e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784045525.667976:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1870706873909248:0@lo:38:kworker.0 00000100:00100000:2.0:1784045525.677057:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1870706873909120:12345-0@lo:38:kworker.0 Request processed in 10963us (11335us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784045525.677069:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1784045525.677129:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c937bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784045525.677134:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784045525.677137:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873909120:0@lo:38:kworker.0 00000020:00000004:0.0:1784045525.852729:0:17509:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045525.853102:0:17509:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784045526.040670:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784045526.676042:0:17559:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784045526.676256:0:17559:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784045526.677101:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:3.0:1784045527.059627:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045527.700511:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:3.0:1784045528.083687:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045528.724562:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:3.0:1784045529.108035:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045529.749714:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:3.0:1784045530.132273:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784045530.773171:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784045530.773178:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784045530.773181:0:8:0:(import.c:65:import_set_state_nolock()) ffff939c937bd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784045530.773189:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 481 00000100:00080000:0.0:1784045530.773194:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784045530.773201:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff939c937bd800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045530.773235:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939c91560e00 x1870706873909504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784045530.773255:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045530.773259:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784045530.773262:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045530.773265:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784045530.773429:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045520/real 1784045520] req@ffff939c91562680 x1870706873906176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045530 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045530.773484:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939c91562680 x1870706873906176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045530 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045530.773495:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045520/real 1784045520] req@ffff939c91562a00 x1870706873906048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045530 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045530.773505:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939c91562a00 x1870706873906048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045530 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045530.773537:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873909504:0@lo:38:kworker.0 00000100:00100000:0.0:1784045530.773605:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784045530.773659:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb5a99000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784045530.773671:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784045530.773675:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873906176:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1784045530.773679:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c937be000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784045530.773684:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784045530.773686:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873906048:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1784045530.773716:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00000100:00100000:0.0:1784045530.773745:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873909504 00000100:00100000:0.0:1784045530.773752:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873909504 00000100:00100000:0.0:1784045530.773787:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045530.773794:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1870706873909504:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784045530.773810:0:17177:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784045530.776883:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873909376:0@lo:400:kworker.0 00000100:00100000:1.0:1784045530.776964:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045530.777028:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045530.777037:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873909632:0@lo:400:kworker.0 00000100:00100000:1.0:1784045530.777074:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045530.777146:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873909376 00000100:00100000:1.0:1784045530.777156:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873909376 00000100:00100000:1.0:1784045530.777211:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784045530.777219:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+12:3625:x1870706873909376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045530.777373:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+12:3625:x1870706873909376:12345-0@lo:400:kworker.0 Request processed in 154us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045530.777383:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784045530.777438:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873909376:0@lo:400:kworker.0 00000100:00080000:3.0:1784045530.777559:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045530.777574:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784045530.777578:0:37:0:(import.c:65:import_set_state_nolock()) ffff939c937be000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045530.777583:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:3.0:1784045530.777587:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784045530.777592:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939c937be000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045530.777620:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82881180 x1870706873909760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045530.777646:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045530.777650:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784045530.777651:0:37:0:(import.c:65:import_set_state_nolock()) ffff939cb5a99000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045530.777654:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:3.0:1784045530.777657:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784045530.777660:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939cb5a99000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045530.777673:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82881c00 x1870706873909888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784045530.777961:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873909760:0@lo:8:kworker.0 00000100:00100000:2.0:1784045530.778813:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873909632 00000100:00100000:2.0:1784045530.778822:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873909632 00000100:00100000:2.0:1784045530.778881:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784045530.778890:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873909632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045530.778968:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873909632:12345-0@lo:400:kworker.0 Request processed in 80us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045530.778974:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000400:00000100:1.0:1784045530.783047:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706873909760 offset 0 length 520: 4 00010000:00080000:2.0:1784045530.784313:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff939c91563100 x1870706873909632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045530.784331:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873909632:0@lo:400:kworker.0 00000100:00100000:1.0:1784045530.784502:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873909888:0@lo:8:kworker.0 00000400:00000100:1.0:1784045530.784547:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706873909888 offset 0 length 520: 4 00000100:00100000:0.0:1784045530.797787:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1870706873909504:12345-0@lo:38:kworker.0 Request processed in 23984us (24173us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784045530.797816:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1784045530.797968:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c937bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784045530.797974:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784045530.797979:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873909504:0@lo:38:kworker.0 00010000:00010000:3.0:1784045531.155726:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045531.795666:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:3.0:1784045532.180188:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784045532.761727:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784045532.822536:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:1.0:1784045533.204088:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784045533.244158:0:17904:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784045533.244163:0:17904:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1784045533.244164:0:17904:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1784045533.244280:0:17904:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff939c92653800 00000020:01000004:1.0:1784045533.244295:0:17904:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1784045533.244307:0:17904:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784045533.244320:0:17904:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff939cc13a0000) 00000020:00000080:1.0:1784045533.244336:0:17904:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784045533.301947:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784045533.308060:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.309590:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.310105:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.310303:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.310770:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.311545:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.311802:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.312184:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.312420:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.312718:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.312982:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.313232:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.313422:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.313939:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.315099:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.315357:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.315764:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.316119:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.316413:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.316697:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.316948:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.317260:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.317530:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.317765:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.318108:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.318279:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.318545:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.318783:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.319158:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.319368:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.319568:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1784045533.319740:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.323190:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1784045533.325177:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1784045533.325431:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784045533.325999:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784045533.328638:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784045533.329418:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1784045533.332159:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1784045533.332437:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1784045533.332856:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1784045533.333143:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784045533.333420:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1784045533.333801:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784045533.334281:0:17904:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1784045533.341030:0:17904:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784045533.341388:0:17904:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1784045533.341402:0:17904:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784045533.341416:0:17904:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5475624df454d7d2 00000020:01000004:0.0:1784045533.341424:0:17904:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1784045533.341592:0:17904:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.144@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784045533.341596:0:17904:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784045533.341603:0:17904:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1784045533.341633:0:17904:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1784045533.341637:0:17904:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1784045533.348917:0:17904:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784045533.348961:0:17904:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.144@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1784045533.348966:0:17904:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784045533.348967:0:17904:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784045533.348968:0:17904:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045533.348969:0:17904:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045533.348970:0:17904:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045533.348972:0:17904:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045533.348973:0:17904:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045533.348975:0:17904:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045533.348976:0:17904:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784045533.348979:0:17904:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1784045533.348981:0:17904:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784045533.348983:0:17904:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784045533.348984:0:17904:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045533.348985:0:17904:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045533.348986:0:17904:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045533.348987:0:17904:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045533.348988:0:17904:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045533.348989:0:17904:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045533.348990:0:17904:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784045533.349630:0:17904:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1784045533.349653:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910016:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784045533.349730:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045533.349883:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c87d65b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.350085:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873910016 00000100:00100000:3.0:1784045533.350093:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873910016 00000100:00100000:3.0:1784045533.350189:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784045533.350199:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17904:x1870706873910016:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784045533.350246:0:17164:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784045533.350250:0:17164:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1784045533.350258:0:17164:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1784045533.350681:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17904:x1870706873910016:12345-0@lo:253:mount.lustre.0 Request processed in 482us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.350690:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784045533.350768:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910016:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784045533.350781:0:17904:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1784045533.350784:0:17904:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784045533.350786:0:17904:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784045533.350787:0:17904:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045533.350789:0:17904:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045533.350790:0:17904:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045533.350791:0:17904:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045533.350793:0:17904:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784045533.350795:0:17904:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045533.350796:0:17904:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784045533.350824:0:17904:0:(tgt_mount.c:101:server_register_mount()) register mount ffff939c92653800 from lustre-MDT0001 10000000:01000000:0.0:1784045533.350852:0:17904:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1784045533.350855:0:17904:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1784045533.350861:0:17904:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff939b832619c0 local copy 00010000:00010000:0.0:1784045533.350872:0:17904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6cf expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045533.350966:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045533.351013:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045533.352146:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c873eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1784045533.352224:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873910144 00000100:00100000:1.0:1784045533.352232:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873910144 00000100:00100000:1.0:1784045533.352279:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784045533.352287:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17904:x1870706873910144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045533.352435:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17904:x1870706873910144:12345-0@lo:501:mount.lustre.0 Request processed in 147us (1421us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784045533.352456:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784045533.352772:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910144:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1784045533.352790:0:17904:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784045533.352825:0:17904:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784045533.352833:0:17904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6cf expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.352861:0:17904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6cf expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045533.352888:0:17904:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff939c92653800 10000000:01000000:0.0:1784045533.352893:0:17904:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784045533.352898:0:17904:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff939b832619c0 10000000:01000000:0.0:1784045533.352901:0:17904:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1784045533.352904:0:17904:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff939b832619c0 from 1 10000000:01000000:0.0:1784045533.352907:0:17904:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784045533.353084:0:17904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2200/0x5475624df454d7d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.353092:0:17904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c918b2200/0x5475624df454d7d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.353101:0:17904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c918b2200/0x5475624df454d7d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045533.353118:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784045533.353152:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045533.353174:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c873eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1784045533.353929:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873910272 00000100:00100000:1.0:1784045533.353936:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873910272 00000100:00100000:1.0:1784045533.353988:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784045533.354108:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+12:17904:x1870706873910272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045533.354121:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045533.354151:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b836cc400/0x5475624df454d7e0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d7d9 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.354177:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836cc400/0x5475624df454d7e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d7d9 expref: 13 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.354186:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b836cc400/0x5475624df454d7e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d7d9 expref: 13 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.354195:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cc400, rc 0) 00000100:00100000:1.0:1784045533.354254:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+13:17904:x1870706873910272:12345-0@lo:101:mount.lustre.0 Request processed in 150us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045533.356397:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045533.356423:0:17904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c918b2200/0x5475624df454d7d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d7e0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.356435:0:17904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c918b2200/0x5475624df454d7d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d7e0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045533.356506:0:17904:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784045533.356524:0:17904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2200/0x5475624df454d7d9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d7e0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.356531:0:17904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c918b2200/0x5475624df454d7d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d7e0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045533.356543:0:17904:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff939c92653800 10000000:01000000:0.0:1784045533.356560:0:17904:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784045533.356566:0:17904:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff939c92653800 from 1 10000000:01000000:0.0:1784045533.356569:0:17904:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784045533.356601:0:17904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2c00/0x5475624df454d7e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.356609:0:17904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c918b2c00/0x5475624df454d7e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.356618:0:17904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c918b2c00/0x5475624df454d7e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045533.356638:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784045533.356694:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045533.356729:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c873eef00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045533.356917:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873910400 00000100:00100000:2.0:1784045533.356924:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873910400 00000100:00100000:1.0:1784045533.365734:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784045533.367834:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784045533.367859:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+13:17904:x1870706873910400:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045533.367878:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045533.367900:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81987a00/0x5475624df454d7ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d7e7 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045533.367929:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987a00/0x5475624df454d7ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d7e7 expref: 14 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045533.367940:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81987a00/0x5475624df454d7ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d7e7 expref: 14 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045533.367950:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987a00, rc 0) 00000100:00100000:2.0:1784045533.368030:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+14:17904:x1870706873910400:12345-0@lo:101:mount.lustre.0 Request processed in 185us (11336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045533.368037:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784045533.368256:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910400:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045533.368273:0:17904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c918b2c00/0x5475624df454d7e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d7ee expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.368283:0:17904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c918b2c00/0x5475624df454d7e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d7ee expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045533.368317:0:17904:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784045533.368332:0:17904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2c00/0x5475624df454d7e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d7ee expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.368339:0:17904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c918b2c00/0x5475624df454d7e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d7ee expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045533.368348:0:17904:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1784045533.368352:0:17904:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784045533.368358:0:17904:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff939c92653800 10000000:01000000:0.0:1784045533.368360:0:17904:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784045533.368364:0:17904:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1784045533.368366:0:17904:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1784045533.368387:0:17904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b3800/0x5475624df454d7f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.368394:0:17904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c918b3800/0x5475624df454d7f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.368403:0:17904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c918b3800/0x5475624df454d7f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045533.368422:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784045533.368473:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045533.368500:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c873eef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.368568:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873910528 00000100:00100000:3.0:1784045533.368574:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873910528 00000100:00100000:3.0:1784045533.368622:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784045533.368630:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+14:17904:x1870706873910528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045533.368638:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045533.368649:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c93633200/0x5475624df454d7fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d7f5 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045533.368663:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c93633200/0x5475624df454d7fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d7f5 expref: 15 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045533.368684:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c93633200/0x5475624df454d7fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d7f5 expref: 15 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045533.368692:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93633200, rc 0) 00000100:00100000:3.0:1784045533.368719:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+15:17904:x1870706873910528:12345-0@lo:101:mount.lustre.0 Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.368725:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784045533.368802:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045533.368822:0:17904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c918b3800/0x5475624df454d7f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d7fc expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.368837:0:17904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c918b3800/0x5475624df454d7f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d7fc expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045533.370746:0:17904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1784045533.371579:0:17904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045533.377926:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1784045533.378005:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1784045533.378020:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1784045533.378034:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1784045533.378046:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1784045533.378059:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1784045533.378070:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1784045533.378082:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1784045533.378092:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1784045533.378105:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1784045533.378117:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1784045533.378130:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1784045533.378148:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1784045533.378161:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1784045533.378176:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1784045533.378191:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1784045533.378204:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1784045533.378216:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1784045533.378229:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1784045533.378240:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1784045533.378254:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1784045533.378268:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1784045533.378679:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1784045533.378725:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1784045533.378732:0:17904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1784045533.379968:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045533.380056:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045533.380173:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939ca1cdd840 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.380428:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873910656 00000100:00100000:3.0:1784045533.380436:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873910656 00000100:00100000:3.0:1784045533.380512:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784045533.380521:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+15:17904:x1870706873910656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045533.380711:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+15:17904:x1870706873910656:12345-0@lo:501:mount.lustre.0 Request processed in 190us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.380719:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784045533.381434:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045533.381528:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784045533.381598:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045533.381628:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045533.381755:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873910784 00000100:00100000:2.0:1784045533.381761:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873910784 00000100:00100000:2.0:1784045533.381802:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784045533.381817:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+15:17904:x1870706873910784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045533.382693:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+15:17904:x1870706873910784:12345-0@lo:503:mount.lustre.0 Request processed in 880us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045533.382710:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784045533.382849:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910784:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784045533.383323:0:17904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784045533.383416:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784045533.383714:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045533.383793:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.384051:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873910912 00000100:00100000:3.0:1784045533.384059:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873910912 00000100:00100000:3.0:1784045533.384146:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784045533.384157:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+15:17904:x1870706873910912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045533.386961:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+15:17904:x1870706873910912:12345-0@lo:502:mount.lustre.0 Request processed in 2796us (3236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.386980:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784045533.387193:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873910912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784045533.387710:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1784045533.387751:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1784045533.387768:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1784045533.387780:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1784045533.388050:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1784045533.388077:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1784045533.388102:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1784045533.388123:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1784045533.388236:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1784045533.388257:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1784045533.388271:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1784045533.388296:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1784045533.388313:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1784045533.388327:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1784045533.388340:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1784045533.388354:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1784045533.388365:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1784045533.388378:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1784045533.388391:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1784045533.388407:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1784045533.388421:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1784045533.388436:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1784045533.388568:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1784045533.388599:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1784045533.388623:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1784045533.388642:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1784045533.388656:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1784045533.388670:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1784045533.388686:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1784045533.388698:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1784045533.388710:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1784045533.388724:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1784045533.388738:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1784045533.389158:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1784045533.389186:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1784045533.389227:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1784045533.389248:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1784045533.389268:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1784045533.389530:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1784045533.389653:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1784045533.389678:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1784045533.389699:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1784045533.389717:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1784045533.389732:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1784045533.389792:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873911040:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784045533.390010:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045533.391080:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.395937:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873911040 00000100:00100000:3.0:1784045533.395952:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873911040 00000100:00100000:3.0:1784045533.396036:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784045533.396046:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+15:17904:x1870706873911040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045533.396400:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+15:17904:x1870706873911040:12345-0@lo:502:mount.lustre.0 Request processed in 354us (6390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.396415:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784045533.398673:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873911040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784045533.398795:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1784045533.401410:0:17904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1784045533.402845:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045533.402858:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.402861:0:17908:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1784045533.402867:0:17908:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1784045533.402871:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045533.402885:0:17908:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff939cb58b0000) 00000020:00000080:2.0:1784045533.402908:0:17908:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1784045533.402914:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784045533.402987:0:17908:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784045533.403004:0:17908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5475624df454d80a 00000020:00000080:2.0:1784045533.403221:0:17908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1784045533.403226:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045533.403229:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.403231:0:17908:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1784045533.403234:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045533.403237:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.403239:0:17908:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1784045533.403242:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045533.403249:0:17908:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff939cb58b19c0) 00000020:00000080:2.0:1784045533.403260:0:17908:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1784045533.403264:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784045533.403266:0:17908:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1784045533.403268:0:17908:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1784045533.403275:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784045533.403337:0:17908:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939c92653800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1784045533.403350:0:17908:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff939cb58b3380) 00000020:00000080:2.0:1784045533.403359:0:17908:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1784045533.403434:0:17908:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784045533.403439:0:17908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454d81f 00000020:00000080:2.0:1784045533.404234:0:17908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1784045533.404245:0:17908:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784045533.404259:0:17908:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5475624df454d826 00080000:01000000:2.0:1784045533.404266:0:17908:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784045533.404270:0:17908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5475624df454d82d 00010000:00010000:1.0:1784045533.516724:0:17908:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1784045533.520726:0:17908:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1784045533.521383:0:17908:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1784045533.529884:0:17908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1784045533.529897:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045533.529904:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045533.529907:0:17908:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1784045533.529912:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045533.529918:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045533.529919:0:17908:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1784045533.529922:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784045533.529927:0:17908:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:00000080:1.0:1784045533.529954:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784045533.529970:0:17908:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff939cc13a4d40) 00000020:00000080:1.0:1784045533.529992:0:17908:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1784045533.529998:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784045533.530069:0:17908:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1784045533.530085:0:17908:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784045533.530092:0:17908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5475624df454d83b 00010000:00080000:1.0:1784045533.530125:0:17908:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939cb7b8a800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:1.0:1784045533.535793:0:17908:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1784045533.546217:0:17908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784045533.546237:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1784045533.546344:0:17908:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784045533.546372:0:17908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454d842 00000100:00080000:2.0:1784045533.546396:0:17908:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784045533.546403:0:17908:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff939cb7b8a800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045533.547365:0:17908:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939cbf4cce00 x1870706873911168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045533.547396:0:17908:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1784045533.547507:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045533.547512:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.547514:0:17908:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1784045533.547517:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784045533.547521:0:17908:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1784045533.547522:0:17908:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784045533.547524:0:17908:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784045533.547525:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784045533.547528:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.547529:0:17908:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784045533.547532:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045533.547537:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.547538:0:17908:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1784045533.547542:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784045533.547594:0:17908:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784045533.547607:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045533.547610:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.547612:0:17908:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1784045533.547615:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784045533.547616:0:17908:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1784045533.547625:0:17908:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784045533.547628:0:17908:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784045533.547630:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784045533.547633:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.547638:0:17908:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784045533.547641:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784045533.547644:0:17908:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1784045533.547647:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.547648:0:17908:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784045533.547651:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784045533.547654:0:17908:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:2.0:1784045533.547677:0:17908:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1784045533.547680:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045533.547701:0:17908:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff939cbb620000) 00000020:00000080:2.0:1784045533.547717:0:17908:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1784045533.547724:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784045533.547793:0:17908:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1784045533.547800:0:17908:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784045533.547817:0:17908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5475624df454d850 00000100:00100000:1.0:1784045533.548355:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873911168:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784045533.548437:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045533.548532:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873911168 00000100:00100000:1.0:1784045533.548539:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873911168 00000100:00100000:1.0:1784045533.548575:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045533.548582:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1870706873911168:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784045533.548607:0:17178:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:1.0:1784045533.548633:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454d857 00000004:00100000:1.0:1784045533.548646:0:17178:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1784045533.548652:0:17178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:2.0:1784045533.549968:0:17908:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939cb59c6800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:2.0:1784045533.550203:0:17908:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1784045533.551161:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784045533.551169:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1784045533.551172:0:8:0:(import.c:65:import_set_state_nolock()) ffff939c937bd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045533.551179:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:3.0:1784045533.551185:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784045533.551191:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff939c937bd800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045533.551224:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82881880 x1870706873911296/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045533.551259:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045533.551263:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784045533.551265:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045533.551269:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784045533.551346:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045533.551362:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873911424:0@lo:400:kworker.0 00000100:00100000:3.0:1784045533.551425:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045533.551509:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873911424 00000100:00100000:3.0:1784045533.551516:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873911424 00000100:00100000:3.0:1784045533.551572:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045533.551579:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873911424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045533.551625:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873911424:12345-0@lo:400:kworker.0 Request processed in 46us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.551631:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784045533.551662:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff939b82882300 x1870706873911424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045533.551685:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873911424:0@lo:400:kworker.0 00000100:00100000:2.0:1784045533.552734:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873911296:0@lo:38:kworker.0 00000100:00100000:2.0:1784045533.552797:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045533.553185:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1784045533.553196:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1784045533.553539:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873911296 00000100:00100000:1.0:1784045533.553556:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873911296 00000100:00100000:0.0:1784045533.553693:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045533.553700:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1870706873911296:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784045533.553774:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1870706873911296:12345-0@lo:38:kworker.0 Request processed in 73us (976us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784045533.553781:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784045533.554126:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784045533.554135:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c937bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784045533.554139:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784045533.554143:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873911296:0@lo:38:kworker.0 00000040:01000000:3.0:1784045533.555951:0:17908:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784045533.556174:0:17908:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1784045533.559398:0:17908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1784045533.560073:0:17178:0:(import.c:65:import_set_state_nolock()) ffff939cb7b8f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784045533.560173:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1870706873911168:12345-0@lo:38:llog_process_th.0 Request processed in 11588us (11734us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045533.560183:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045533.560272:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784045533.560291:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1784045533.560300:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784045533.560314:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784045533.560317:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb7b8a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784045533.560331:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873911168:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784045533.560937:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873911552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045533.560984:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1784045533.561160:0:17908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1784045533.561401:0:17908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1784045533.562021:0:17914:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784045533.562026:0:17914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784045533.562803:0:17908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000100:00100000:0.0:1784045533.563003:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873911552 00000100:00100000:0.0:1784045533.563012:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873911552 00000100:00100000:0.0:1784045533.563059:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045533.563068:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1870706873911552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784045533.563105:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000020:00000080:2.0:1784045533.563188:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784045533.563231:0:17908:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784045533.563253:0:17908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454d85e 00000100:00080000:2.0:1784045533.563261:0:17908:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784045533.563266:0:17908:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff939cb59c6800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045533.563309:0:17908:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939cbf4cce00 x1870706873911680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045533.563334:0:17908:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784045533.563361:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045533.563365:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784045533.563367:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045533.563370:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1784045533.563413:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045533.563417:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.563419:0:17908:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784045533.563422:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784045533.563425:0:17908:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1784045533.563426:0:17908:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784045533.563428:0:17908:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784045533.563441:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784045533.563464:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.563466:0:17908:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784045533.563470:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784045533.563474:0:17908:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1784045533.563477:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.563478:0:17908:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784045533.563481:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784045533.563485:0:17908:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.144@tcp to nid 0x20000c0a8cb90 (192.168.203.144@tcp) 00000020:01000000:2.0:1784045533.563506:0:17908:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1784045533.563508:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784045533.563520:0:17908:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff939cbb624d40) 00000020:00000080:2.0:1784045533.563532:0:17908:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1784045533.563537:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784045533.563626:0:17908:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1784045533.563633:0:17908:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784045533.563639:0:17908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5475624df454d86c 00010000:00080000:2.0:1784045533.563669:0:17908:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939cb59c2000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:2.0:1784045533.563891:0:17908:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1784045533.563959:0:17908:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784045533.563975:0:17908:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:3.0:1784045533.564209:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873911680:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1784045533.564254:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706873911680 offset 0 length 520: 4 00000100:00100000:0.0:1784045533.568613:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1870706873911552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5538us (7621us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045533.568629:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:2.0:1784045533.569026:0:17908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784045533.570795:0:17908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1784045533.570994:0:17908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:1.0:1784045533.571763:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873911552:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1784045533.575166:0:17916:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784045533.575175:0:17916:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784045533.576950:0:17908:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1784045533.576966:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784045533.577009:0:17908:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784045533.577033:0:17908:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454d873 00000100:00080000:2.0:1784045533.577045:0:17908:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784045533.577051:0:17908:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939cb59c2000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045533.577086:0:17908:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939cbf4cf100 x1870706873911808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045533.577125:0:17908:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784045533.577191:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045533.577195:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.577197:0:17908:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784045533.577200:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045533.577204:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.577206:0:17908:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784045533.577209:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784045533.577210:0:17908:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784045533.577212:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045533.577215:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.577216:0:17908:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784045533.577219:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045533.577221:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.577223:0:17908:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784045533.577227:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784045533.577257:0:17908:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045533.577260:0:17908:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.577262:0:17908:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784045533.577265:0:17908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:0.0:1784045533.577528:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045533.577534:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784045533.577536:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045533.577539:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784045533.577817:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873911808:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1784045533.577883:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706873911808 offset 0 length 520: 4 00000020:01000000:1.0:1784045533.578085:0:17904:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1784045533.578114:0:17904:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784045533.578134:0:17904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b3800/0x5475624df454d7f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d7fc expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.578151:0:17904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c918b3800/0x5475624df454d7f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d7fc expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045533.578158:0:17904:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939c92653800 from 1 10000000:01000000:1.0:1784045533.578160:0:17904:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784045533.578186:0:17904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.578193:0:17904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.578202:0:17904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045533.578219:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873911936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784045533.578256:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045533.578285:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.578391:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873911936 00000100:00100000:3.0:1784045533.578398:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873911936 00000100:00100000:3.0:1784045533.578478:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784045533.578488:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+15:17904:x1870706873911936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045533.578501:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045533.578513:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c93632a00/0x5475624df454d881 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d87a expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045533.578535:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c93632a00/0x5475624df454d881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d87a expref: 16 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045533.578545:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c93632a00/0x5475624df454d881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d87a expref: 16 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045533.578563:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93632a00, rc 0) 00000100:00100000:3.0:1784045533.578607:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+16:17904:x1870706873911936:12345-0@lo:101:mount.lustre.0 Request processed in 120us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.578613:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784045533.578794:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873911936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045533.578818:0:17904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d881 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.578827:0:17904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d881 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045533.579359:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912064:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784045533.579404:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045533.579475:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.579683:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873912064 00000100:00100000:3.0:1784045533.579690:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873912064 00000100:00100000:3.0:1784045533.579733:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784045533.579741:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+16:17904:x1870706873912064:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784045533.579759:0:17164:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784045533.579777:0:17164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784045533.579780:0:17164:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1784045533.579880:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+16:17904:x1870706873912064:12345-0@lo:256:mount.lustre.0 Request processed in 139us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.579887:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784045533.580042:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912064:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784045533.582370:0:17904:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784045533.582472:0:17904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d881 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.582486:0:17904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d881 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045533.582587:0:17904:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939c92653800 from 1 10000000:01000000:0.0:1784045533.582591:0:17904:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784045533.582634:0:17904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.582653:0:17904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.582664:0:17904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045533.582689:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784045533.582753:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045533.582806:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c87338e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784045533.583138:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873912192 00000100:00100000:1.0:1784045533.583147:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873912192 00000100:00100000:1.0:1784045533.583207:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784045533.583217:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+16:17904:x1870706873912192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045533.583230:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045533.583246:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b836ccc00/0x5475624df454d88f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d888 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.583268:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836ccc00/0x5475624df454d88f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d888 expref: 17 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.583278:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b836ccc00/0x5475624df454d88f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d888 expref: 17 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.583287:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836ccc00, rc 0) 00000100:00100000:1.0:1784045533.583336:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17904:x1870706873912192:12345-0@lo:101:mount.lustre.0 Request processed in 121us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045533.583342:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784045533.583441:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045533.583479:0:17904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d88f expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045533.583488:0:17904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d88f expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045533.583647:0:17904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784045533.583682:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045533.583722:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045533.583753:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c878e1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045533.584177:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873912320 00000100:00100000:1.0:1784045533.584182:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873912320 00000100:00100000:1.0:1784045533.584217:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784045533.584231:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17904:x1870706873912320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045533.584317:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17904:x1870706873912320:12345-0@lo:501:mount.lustre.0 Request processed in 86us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045533.584323:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784045533.584358:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91562680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045533.584393:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784045533.584425:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045533.584463:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873912448 00000100:00100000:1.0:1784045533.584466:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873912448 00000100:00100000:1.0:1784045533.584482:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784045533.584487:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17904:x1870706873912448:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784045533.584558:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17904:x1870706873912448:12345-0@lo:503:mount.lustre.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045533.584565:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784045533.584604:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045533.584615:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912448:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784045533.586171:0:17904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784045533.586258:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912576:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784045533.586326:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045533.586375:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.586541:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873912576 00000100:00100000:3.0:1784045533.586556:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873912576 00000100:00100000:3.0:1784045533.586593:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784045533.586601:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17904:x1870706873912576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045533.586711:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17904:x1870706873912576:12345-0@lo:502:mount.lustre.0 Request processed in 110us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.586719:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784045533.586866:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784045533.587076:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1784045533.587115:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1784045533.587127:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1784045533.587137:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1784045533.587153:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1784045533.587162:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1784045533.587172:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1784045533.587181:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1784045533.587190:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1784045533.587199:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1784045533.587208:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1784045533.587228:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912704:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784045533.587262:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045533.587293:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.587409:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873912704 00000100:00100000:3.0:1784045533.587413:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873912704 00000100:00100000:3.0:1784045533.587466:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784045533.587472:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17904:x1870706873912704:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045533.587563:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17904:x1870706873912704:12345-0@lo:502:mount.lustre.0 Request processed in 91us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.587571:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784045533.587656:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784045533.587698:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1784045533.587707:0:17904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1784045533.588588:0:17918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045533.588597:0:17918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.588599:0:17918:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784045533.588606:0:17918:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939c92653800 00000020:00000080:2.0:1784045533.588608:0:17918:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784045533.588615:0:17918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045533.588618:0:17918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.588619:0:17918:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784045533.588621:0:17918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045533.588624:0:17918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.588625:0:17918:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784045533.588628:0:17918:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939c92653800 00000020:00000080:2.0:1784045533.588637:0:17918:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784045533.588685:0:17918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045533.588689:0:17918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.588690:0:17918:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784045533.588693:0:17918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045533.588695:0:17918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.588696:0:17918:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784045533.588700:0:17918:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939c92653800 00000020:00000080:2.0:1784045533.588702:0:17918:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784045533.588719:0:17918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045533.588722:0:17918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.588723:0:17918:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784045533.588725:0:17918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784045533.588727:0:17918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.588728:0:17918:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1784045533.588731:0:17918:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939c92653800 00000020:00000080:2.0:1784045533.588733:0:17918:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784045533.588754:0:17918:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784045533.588757:0:17918:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784045533.588759:0:17918:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1784045533.588762:0:17918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1784045533.590568:0:17904:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1784045533.590848:0:17904:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784045533.590871:0:17904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d88f expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.590883:0:17904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d88f expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045533.590958:0:17904:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784045533.590962:0:17904:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff939c92653800 10000000:01000000:1.0:1784045533.590965:0:17904:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff939c92653800 10000000:01000000:1.0:1784045533.590969:0:17904:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784045533.590975:0:17904:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939c92653800 from 1 10000000:01000000:1.0:1784045533.590978:0:17904:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784045533.591031:0:17904:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cc200/0x5475624df454d896 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.591040:0:17904:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b836cc200/0x5475624df454d896 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.591050:0:17904:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b836cc200/0x5475624df454d896 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045533.591079:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784045533.591142:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045533.591189:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045533.591389:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873912832 00000100:00100000:2.0:1784045533.591396:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873912832 00000100:00100000:2.0:1784045533.591467:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784045533.591477:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17904:x1870706873912832:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045533.591490:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045533.591503:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81986000/0x5475624df454d89d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d896 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045533.591524:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986000/0x5475624df454d89d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d896 expref: 18 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045533.591559:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81986000/0x5475624df454d89d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d896 expref: 18 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045533.591568:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986000, rc 0) 00000100:00100000:2.0:1784045533.591615:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17904:x1870706873912832:12345-0@lo:101:mount.lustre.0 Request processed in 139us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045533.591622:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784045533.591670:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045533.591684:0:17904:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b836cc200/0x5475624df454d896 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d89d expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045533.591693:0:17904:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b836cc200/0x5475624df454d896 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d89d expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784045533.592938:0:17904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1784045533.593199:0:17904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784045533.593390:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1784045533.593416:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1784045533.593430:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1784045533.593474:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1784045533.593503:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1784045533.593517:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1784045533.593528:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1784045533.593541:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1784045533.593567:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1784045533.593581:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1784045533.593595:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1784045533.593606:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1784045533.593632:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1784045533.593644:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1784045533.593656:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1784045533.593667:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1784045533.593679:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1784045533.593691:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1784045533.593704:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1784045533.593717:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1784045533.593744:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1784045533.593759:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1784045533.593772:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1784045533.593787:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1784045533.593800:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1784045533.593891:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1784045533.593912:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1784045533.593925:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1784045533.593944:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1784045533.593949:0:17904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1784045533.594024:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045533.594081:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045533.594131:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92daa300 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.594216:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873912960 00000100:00100000:3.0:1784045533.594223:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873912960 00000100:00100000:3.0:1784045533.594270:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784045533.594278:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17904:x1870706873912960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045533.594395:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17904:x1870706873912960:12345-0@lo:501:mount.lustre.0 Request processed in 117us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.594402:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784045533.594560:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873912960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045533.594590:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873913088:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045533.594626:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045533.594731:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92daa300 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.600619:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873913088 00000100:00100000:3.0:1784045533.600634:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873913088 00000100:00100000:3.0:1784045533.600708:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784045533.600718:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17904:x1870706873913088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784045533.600889:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17904:x1870706873913088:12345-0@lo:503:mount.lustre.0 Request processed in 172us (6262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.600896:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784045533.600960:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873913088:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784045533.601390:0:17904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784045533.601509:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873913216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045533.601573:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045533.601608:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c91ff1900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.601628:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873913216 00000100:00100000:3.0:1784045533.601633:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873913216 00000100:00100000:3.0:1784045533.601657:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784045533.601664:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17904:x1870706873913216:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045533.601741:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17904:x1870706873913216:12345-0@lo:502:mount.lustre.0 Request processed in 77us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.601749:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784045533.601786:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873913216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784045533.601979:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1784045533.602001:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1784045533.602021:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1784045533.602035:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1784045533.602046:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1784045533.602056:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1784045533.602068:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1784045533.602082:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1784045533.602097:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1784045533.602111:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1784045533.602126:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1784045533.602139:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1784045533.602152:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1784045533.602164:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1784045533.602180:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1784045533.602192:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1784045533.602206:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1784045533.602220:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1784045533.602239:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1784045533.602253:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1784045533.602267:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1784045533.602294:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1784045533.602309:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1784045533.602320:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1784045533.602331:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1784045533.602341:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1784045533.602354:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1784045533.602367:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1784045533.602399:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1784045533.602416:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1784045533.602429:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1784045533.602470:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1784045533.602488:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1784045533.602502:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1784045533.602515:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1784045533.602541:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1784045533.602569:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1784045533.602601:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1784045533.602614:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1784045533.602626:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1784045533.602637:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1784045533.602648:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1784045533.602659:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1784045533.602672:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1784045533.602684:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1784045533.602695:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1784045533.602705:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1784045533.602715:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1784045533.602753:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873913344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045533.602806:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045533.602834:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c91ff1900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.602859:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873913344 00000100:00100000:3.0:1784045533.602865:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873913344 00000100:00100000:3.0:1784045533.602896:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784045533.602903:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17904:x1870706873913344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045533.602996:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17904:x1870706873913344:12345-0@lo:502:mount.lustre.0 Request processed in 94us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.603004:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784045533.603055:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873913344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784045533.603205:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1784045533.603228:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1784045533.603247:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873913472:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045533.603279:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045533.603301:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c91ff1900 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.603314:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873913472 00000100:00100000:3.0:1784045533.603318:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873913472 00000100:00100000:3.0:1784045533.603336:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784045533.603342:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17904:x1870706873913472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045533.603412:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17904:x1870706873913472:12345-0@lo:502:mount.lustre.0 Request processed in 70us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045533.603419:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784045533.603483:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873913472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784045533.603516:0:17904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1784045533.603524:0:17904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1784045533.613104:0:17923:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1784045533.613123:0:17923:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff939b83263380) 00000020:00000080:3.0:1784045533.613148:0:17923:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1784045533.613604:0:17923:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939c92653800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1784045533.613609:0:17923:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939c92653800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1784045533.613611:0:17923:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939c92653800 3 00010000:00080000:2.0:1784045533.613641:0:17923:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939cbb6a0000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.144@tcp at head 00010000:00010000:2.0:1784045533.615241:0:17923:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1784045533.615349:0:17923:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1784045533.615398:0:17923:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784045533.615412:0:17923:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5475624df454d8ab 00000100:00080000:2.0:1784045533.615422:0:17923:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784045533.615428:0:17923:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff939cbb6a0000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045533.615511:0:17923:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939cbf4cf480 x1870706873913600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045533.615544:0:17923:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784045533.615595:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045533.615600:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784045533.615603:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045533.615605:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784045533.617036:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1870706873913600:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784045533.617112:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045533.618509:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873913600 00000100:00100000:2.0:1784045533.618521:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873913600 00000100:00100000:2.0:1784045533.618575:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045533.618583:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873913600:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784045533.618611:0:17172:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:2.0:1784045533.618648:0:17172:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5475624df454d8b2 00000004:00100000:2.0:1784045533.618663:0:17172:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784045533.618692:0:17172:0:(import.c:65:import_set_state_nolock()) ffff939cbb6a4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045533.618770:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1870706873913600:12345-0@lo:38:llog_process_th.0 Request processed in 185us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045533.618778:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784045533.618839:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff939cbf4cf480 x1870706873913600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045533.618850:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784045533.618857:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1784045533.618864:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1784045533.618869:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784045533.618871:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cbb6a0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784045533.618878:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1870706873913600:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1784045533.623994:0:17923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1784045533.625575:0:17904:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1784045533.625616:0:17904:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784045533.625643:0:17904:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cc200/0x5475624df454d896 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d89d expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045533.625655:0:17904:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b836cc200/0x5475624df454d896 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d89d expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784045533.625706:0:17904:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784045533.625708:0:17904:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784045533.625710:0:17904:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045533.625711:0:17904:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045533.625712:0:17904:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045533.625714:0:17904:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045533.625716:0:17904:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784045533.625717:0:17904:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045533.625719:0:17904:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784045533.625727:0:17904:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1784045533.625729:0:17904:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784045533.625731:0:17904:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784045533.625731:0:17904:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045533.625732:0:17904:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045533.625733:0:17904:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045533.625734:0:17904:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045533.625735:0:17904:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784045533.625736:0:17904:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045533.625737:0:17904:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784045533.625762:0:17904:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1784045533.625782:0:17904:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873913728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784045533.625862:0:17904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045533.625899:0:17904:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92c48600 going to sleep for 11 seconds 00000100:00100000:3.0:1784045533.625922:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873913728 00000100:00100000:3.0:1784045533.625928:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873913728 00000100:00100000:3.0:1784045533.625972:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784045533.625980:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17904:x1870706873913728:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784045533.626006:0:17167:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784045533.626020:0:17167:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1784045533.636036:0:17152:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1784045533.636080:0:17167:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784045533.636092:0:17167:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1784045533.636163:0:17188:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784045533.636168:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784045533.636191:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636211:0:17188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c93632c00/0x5475624df454d7bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d7b6 expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636219:0:17188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c93632a00/0x5475624df454d881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d87a expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636227:0:17188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636268:0:17188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c93632a00/0x5475624df454d881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454d87a expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636284:0:17188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939c93632a00/0x5475624df454d881 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454d87a expref: 18 pid: 17166 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045533.636298:0:17188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873913856:0@lo:104: 00000100:00100000:1.0:1784045533.636361:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784045533.636409:0:17188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c93632c00/0x5475624df454d7bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454d7b6 expref: 18 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636428:0:17188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939c93632c00/0x5475624df454d7bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454d7b6 expref: 18 pid: 17166 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045533.636437:0:17188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873913984:0@lo:104: 00000100:00100000:1.0:1784045533.636490:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045533.636509:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045533.636559:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873913856 00000100:00100000:1.0:1784045533.636565:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873913856 00000100:00100000:1.0:1784045533.636598:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873913984 00000100:00100000:1.0:1784045533.636600:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873913984 00000100:00100000:1.0:1784045533.636612:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045533.636620:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+4:17188:x1870706873913856:12345-0@lo:104: 00010000:00010000:1.0:1784045533.636630:0:17156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d881 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636677:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045533.636683:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+4:17188:x1870706873913856:12345-0@lo:104: Request processed in 64us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045533.636689:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045533.636719:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784045533.636725:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+3:17188:x1870706873913984:12345-0@lo:104: 00010000:00010000:1.0:1784045533.636732:0:17156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d7bd expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636760:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784045533.636765:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+3:17188:x1870706873913984:12345-0@lo:104: Request processed in 41us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045533.636777:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1784045533.636797:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045533.636802:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d881 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636815:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cd600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045533.636819:0:17161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454d881 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636827:0:17161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454d881 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045533.636834:0:17161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454d881 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045533.636839:0:17161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045533.636864:0:17161:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d881 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636870:0:17161:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045533.636888:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d881 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636894:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b836cd600/0x5475624df454d87a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d881 expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636904:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045533.636906:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d7bd expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636923:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cce00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045533.636926:0:17161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454d7bd expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636933:0:17161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454d7bd expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045533.636938:0:17161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454d7bd expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045533.636943:0:17161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045533.636955:0:17161:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d7bd expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636961:0:17161:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045533.636968:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d7bd expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636973:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d7b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d7bd expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.636984:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045533.636986:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045533.636987:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045533.636993:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045533.637018:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873914112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045533.637050:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045533.637079:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045533.637085:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873914240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045533.637111:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045533.637169:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873914112 00000100:00100000:1.0:1784045533.637174:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873914112 00010000:00010000:1.0:1784045533.637191:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c93632a00/0x5475624df454d881 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d87a expref: 19 pid: 17166 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045533.637210:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873914240 00000100:00100000:1.0:1784045533.637212:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873914240 00010000:00010000:1.0:1784045533.637223:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c93632c00/0x5475624df454d7bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d7b6 expref: 20 pid: 17166 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045533.637234:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045533.637239:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+20:3625:x1870706873914112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045533.637249:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784045533.637250:0:17157:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1784045533.637254:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c93632a00/0x5475624df454d881 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d87a expref: 20 pid: 17166 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045533.637258:0:17157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1784045533.637263:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c93632a00/0x5475624df454d881 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454d87a expref: 20 pid: 17166 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637277:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045533.637312:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+20:3625:x1870706873914112:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045533.637319:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045533.637331:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784045533.637337:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+19:3625:x1870706873914240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045533.637343:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045533.637347:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c93632c00/0x5475624df454d7bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d7b6 expref: 19 pid: 17166 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637367:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c93632c00/0x5475624df454d7bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454d7b6 expref: 19 pid: 17166 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637380:0:17158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637387:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784045533.637398:0:17158:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015662686s 00010000:00010000:1.0:1784045533.637402:0:17158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637408:0:17158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637413:0:17158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637420:0:17158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637424:0:17158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc800 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045533.637428:0:17158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637434:0:17158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637461:0:17158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637477:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045533.637486:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873914112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045533.637498:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+19:3625:x1870706873914240:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045533.637503:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045533.637510:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873914240:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045533.637538:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c93632a00/0x5475624df454d881 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454d87a expref: 18 pid: 17166 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045533.637560:0:17188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873913856:0@lo:104: 00010000:00010000:1.0:1784045533.637570:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c93632c00/0x5475624df454d7bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454d7b6 expref: 17 pid: 17166 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045533.637577:0:17188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873913984:0@lo:104: 00010000:00010000:1.0:1784045533.637590:0:17188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637599:0:17188:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637605:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045533.637611:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b836cc800/0x5475624df454d8b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045533.639225:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+16:17904:x1870706873913728:12345-0@lo:253:mount.lustre.0 Request processed in 13240us (13358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045533.639237:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784045533.639349:0:17904:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:17904:1870706873913728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784045533.639363:0:17904:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1784045533.639366:0:17904:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784045533.639367:0:17904:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784045533.639369:0:17904:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045533.639370:0:17904:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045533.639371:0:17904:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045533.639372:0:17904:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045533.639373:0:17904:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784045533.639375:0:17904:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045533.639376:0:17904:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784045533.639387:0:17904:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1784045533.660516:0:17931:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1784045533.660521:0:17931:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1784045533.660523:0:17904:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1784045533.661005:0:17932:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784045533.661273:0:17904:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1784045533.662341:0:17932:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045533.667835:0:17932:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784045533.667920:0:17932:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1784045533.669328:0:17933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17933:1870706873914368:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1784045533.669894:0:17904:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1784045533.669934:0:17904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784045533.670330:0:17904:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784045533.670337:0:17904:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1784045533.670369:0:17904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784045533.670680:0:17933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045533.670713:0:17933:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fd08cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045533.670771:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873914368 00000100:00100000:1.0:1784045533.670780:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873914368 00000100:00100000:1.0:1784045533.670838:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784045533.670847:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17933:x1870706873914368:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1784045533.670951:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17933:x1870706873914368:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 105us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045533.670959:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045533.671092:0:17933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17933:1870706873914368:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1784045533.671123:0:17933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784045533.671158:0:17933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17933:1870706873914496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1784045533.671192:0:17933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045533.671218:0:17933:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fd08cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045533.671266:0:17913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873914496 00000100:00100000:1.0:1784045533.671273:0:17913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873914496 00000100:00100000:1.0:1784045533.671302:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784045533.671308:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17933:x1870706873914496:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1784045533.672780:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784045533.673318:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784045533.673347:0:17904:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1784045533.673480:0:17904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1784045533.673972:0:17904:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:1.0:1784045533.674298:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17933:x1870706873914496:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 2985us (3100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045533.674309:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784045533.674700:0:17933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17933:1870706873914496:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784045533.674867:0:17933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17933:1870706873914624:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1784045533.674921:0:17933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045533.674996:0:17933:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8558da80 going to sleep for 11 seconds 00000100:00100000:1.0:1784045533.675047:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873914624 00000100:00100000:1.0:1784045533.675053:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873914624 00000100:00100000:1.0:1784045533.675209:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045533.675219:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17933:x1870706873914624:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1784045533.675278:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17933:x1870706873914624:12345-0@lo:900:lod0001_rec0000.0 Request processed in 61us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045533.675285:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784045533.675345:0:17933:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff939c91563800 x1870706873914624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784045549 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045533.675356:0:17933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17933:1870706873914624:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1784045533.675416:0:17933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17933:1870706873914752:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1784045533.675490:0:17933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045533.675504:0:17933:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8558d480 going to sleep for 11 seconds 00000100:00100000:2.0:1784045533.675723:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873914752 00000100:00100000:2.0:1784045533.675728:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873914752 00000100:00100000:2.0:1784045533.675768:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784045533.675775:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17933:x1870706873914752:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1784045533.675848:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17933:x1870706873914752:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 74us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045533.675855:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784045533.675882:0:17933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17933:1870706873914752:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1784045533.675924:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:0.0:1784045533.679092:0:17904:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:2.0:1784045533.679585:0:17933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784045533.679649:0:17933:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784045533.679654:0:17933:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1784045533.695097:0:17904:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1784045533.695138:0:17904:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb20481c4b988 00100000:10000000:0.0:1784045533.695147:0:17904:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1784045533.699515:0:17904:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784045533.699555:0:17904:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784045533.699594:0:17904:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1784045533.699620:0:17904:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1784045533.718022:0:17904:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045533.718222:0:17904:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784045533.850486:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:1.0:1784045534.228280:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784045534.676212:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784045534.868774:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:1.0:1784045535.251976:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784045535.253163:0:17169:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784045535.253170:0:17169:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939c92653800 from 8 10000000:01000000:3.0:1784045535.253176:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784045535.253336:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045535.253349:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045535.253361:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045535.253389:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873914880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045535.253820:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045535.254232:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873914880 00000100:00100000:2.0:1784045535.254242:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873914880 00000100:00100000:2.0:1784045535.254299:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784045535.254308:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+16:17169:x1870706873914880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045535.254323:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045535.254342:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81987c00/0x5475624df454d8c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d8c0 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045535.254367:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987c00/0x5475624df454d8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d8c0 expref: 17 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045535.254372:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be780 going to sleep for 11 seconds 00010000:00010000:2.0:1784045535.254382:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81987c00/0x5475624df454d8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d8c0 expref: 17 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045535.254392:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987c00, rc 0) 00000100:00100000:2.0:1784045535.254473:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17169:x1870706873914880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045535.254480:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784045535.254744:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873914880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045535.254764:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d8c7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045535.254796:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d8c7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045535.254861:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873915008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784045535.254962:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045535.255043:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873915008 00000100:00100000:2.0:1784045535.255048:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873915008 00000100:00100000:2.0:1784045535.255091:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784045535.255099:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17169:x1870706873915008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784045535.255115:0:17167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00000100:00100000:3.0:1784045535.255125:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be780 going to sleep for 11 seconds 20000000:01000000:2.0:1784045535.255131:0:17167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784045535.255137:0:17167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1784045535.255238:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17169:x1870706873915008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045535.255256:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784045535.255272:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873915008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784045535.255317:0:17169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784045535.255324:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d8c7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045535.255332:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d8c7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045535.255341:0:17169:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784045535.255343:0:17169:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939b840c4000 from 8 10000000:01000000:3.0:1784045535.255345:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784045535.255365:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045535.255372:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045535.255379:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045535.255391:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873915136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045535.255427:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045535.255482:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873915136 00000100:00100000:3.0:1784045535.255486:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be780 going to sleep for 11 seconds 00000100:00100000:0.0:1784045535.255488:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873915136 00000100:00100000:0.0:1784045535.255517:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784045535.255525:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17169:x1870706873915136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045535.255532:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045535.255553:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c918b3000/0x5475624df454d8d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d8ce expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045535.255571:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c918b3000/0x5475624df454d8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d8ce expref: 18 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045535.255579:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c918b3000/0x5475624df454d8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d8ce expref: 18 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045535.255587:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b3000, rc 0) 00000100:00100000:0.0:1784045535.255628:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17169:x1870706873915136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045535.255647:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784045535.256933:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873915136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045535.256954:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d8d5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045535.256967:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d8d5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045535.257035:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873915264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784045535.257083:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045535.257198:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc11be780 going to sleep for 11 seconds 00000100:00100000:0.0:1784045535.257366:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873915264 00000100:00100000:0.0:1784045535.257373:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873915264 00000100:00100000:1.0:1784045535.257688:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784045535.257702:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17169:x1870706873915264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784045535.257724:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784045535.257743:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784045535.257746:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1784045535.257992:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17169:x1870706873915264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 293us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045535.258001:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784045535.258094:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873915264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784045535.258272:0:17169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784045535.258282:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d8d5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045535.258292:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d8d5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784045535.700145:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784045535.892510:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:1.0:1784045536.277356:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045536.915948:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00010000:00010000:3.0:1784045537.299787:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045537.947207:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00000001:02000400:0.0:1784045538.008417:0:18176:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784045538.323589:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045538.963674:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045538.963698:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873915392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045538.963769:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045538.963870:0:17913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873915392 00000100:00100000:1.0:1784045538.963878:0:17913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873915392 00000100:00100000:1.0:1784045538.963937:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784045538.963947:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873915392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045538.963991:0:17913:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784045538.964042:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873915392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045538.964049:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784045538.964095:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873915392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045538.965011:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 0 seconds 00000100:00080000:0.0:1784045538.965817:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784045538.965822:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1784045538.965826:0:37:0:(import.c:65:import_set_state_nolock()) ffff939c937bd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784045538.965837:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff939c937bd800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045538.965861:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939c91561c00 x1870706873915648/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784045538.965880:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045538.965884:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784045538.965886:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045538.965890:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784045538.965921:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045538.965925:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784045538.965928:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045538.965931:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784045538.965960:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873915648:0@lo:38:kworker.0 00000100:00100000:0.0:1784045538.966012:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045538.966065:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873915904:0@lo:400:kworker.0 00000100:00100000:0.0:1784045538.966090:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045538.966108:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045538.966114:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873915776:0@lo:400:kworker.0 00000100:00100000:2.0:1784045538.966377:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045538.966391:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873915520:0@lo:400:kworker.0 00000100:00100000:2.0:1784045538.966426:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045538.966490:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873915520 00000100:00100000:1.0:1784045538.966497:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873915520 00000100:00100000:1.0:1784045538.966557:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784045538.966568:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:3623:x1870706873915520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045538.966603:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873915904 00000100:00100000:2.0:1784045538.966609:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873915904 00000100:00100000:1.0:1784045538.966622:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:3623:x1870706873915520:12345-0@lo:400:kworker.0 Request processed in 56us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045538.966642:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784045538.966645:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045538.966655:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873915904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045538.966701:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873915904:12345-0@lo:400:kworker.0 Request processed in 47us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045538.966702:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873915520:0@lo:400:kworker.0 00000100:00100000:2.0:1784045538.966715:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045538.967389:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784045538.967439:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939c91561f80 x1870706873915904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045538.967476:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873915904:0@lo:400:kworker.0 00000100:00100000:0.0:1784045538.967505:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873915648 00000100:00100000:0.0:1784045538.967510:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873915648 00000100:00100000:0.0:1784045538.967552:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784045538.967558:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1870706873915648:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784045538.967581:0:17178:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:0.0:1784045538.967614:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454d8dc 00000004:00100000:0.0:1784045538.967628:0:17178:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1784045538.967634:0:17178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1784045538.967838:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873915776 00000100:00100000:2.0:1784045538.967843:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873915776 00000100:00100000:2.0:1784045538.967879:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045538.967886:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873915776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045538.967945:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1870706873915776:12345-0@lo:400:kworker.0 Request processed in 59us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045538.967952:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784045538.968026:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939c91561880 x1870706873915776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045538.968036:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1870706873915776:0@lo:400:kworker.0 00000100:00080000:0.0:1784045538.997215:0:17178:0:(import.c:65:import_set_state_nolock()) ffff939cbb762000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045538.997326:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1870706873915648:12345-0@lo:38:kworker.0 Request processed in 29765us (31311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045538.997338:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1784045538.997771:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784045538.997789:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1784045538.997795:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1784045538.997798:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c937bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1784045538.997826:0:3622:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005bcd2309): req@ffff939c91563480 x1870706873908608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045538.997848:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873915648:0@lo:38:kworker.0 00000100:00100000:0.0:1784045538.997953:0:17214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045538.997994:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c900 going to sleep for 11 seconds 00000100:00100000:1.0:1784045538.998045:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873908608 00000100:00100000:1.0:1784045538.998051:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873908608 00000100:00100000:1.0:1784045538.998097:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784045538.998106:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17214:x1870706873908608:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784045538.998176:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17214:x1870706873908608:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 71us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045538.998184:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784045538.998253:0:17214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17214:1870706873908608:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1784045538.998286:0:17214:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784045538.998324:0:17214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17214:1870706873916032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784045538.998355:0:17214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045538.998385:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a7a600 going to sleep for 11 seconds 00000100:00100000:1.0:1784045538.998427:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873916032 00000100:00100000:1.0:1784045538.998432:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873916032 00000100:00100000:1.0:1784045538.998611:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784045538.998619:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17214:x1870706873916032:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784045538.998721:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17214:x1870706873916032:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 103us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045538.998729:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045538.998792:0:17214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17214:1870706873916032:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784045538.998874:0:17214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17214:1870706873916160:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784045538.998904:0:17214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045538.998925:0:17214:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a7a600 going to sleep for 11 seconds 00000100:00100000:2.0:1784045538.999047:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873916288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045538.999078:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045538.999110:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873916160 00000100:00100000:2.0:1784045538.999114:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873916160 00000100:00100000:2.0:1784045538.999908:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873916288 00000100:00100000:2.0:1784045538.999915:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873916288 00000100:00100000:2.0:1784045538.999931:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045538.999946:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17214:x1870706873916160:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784045539.000030:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17214:x1870706873916160:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 85us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045539.000037:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045539.000051:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045539.000057:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1870706873916288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784045539.000077:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784045539.000111:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1870706873916288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045539.000117:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045539.000151:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873916288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045539.000613:0:17214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17214:1870706873916160:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1784045539.000825:0:17214:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784045539.002930:0:17214:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784045539.003018:0:17214:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:0.0:1784045539.003023:0:17214:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1784045539.055714:0:18228:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045539.055932:0:18228:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784045539.351117:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784045539.930294:0:18278:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784045539.930556:0:18278:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784045540.371616:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784045541.026214:0:18326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffee350250 20000000:00000080:3.0:1784045541.026237:0:18326:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939cbb7e4000 uarg=0000000000000000 20000000:01000000:3.0:1784045541.026289:0:18326:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1784045541.026297:0:18326:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1784045541.026303:0:18326:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1784045541.026959:0:18327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1784045541.027132:0:18326:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784045541.037330:0:18326:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784045541.037795:0:18326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045541.037816:0:18326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b81986e00/0x5475624df454d78c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d785 expref: 17 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045541.038075:0:18326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b836ccc00/0x5475624df454d88f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d888 expref: 17 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045541.038086:0:18326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045541.038141:0:18326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b836ccc00/0x5475624df454d88f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454d888 expref: 17 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045541.038173:0:18326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939b836ccc00/0x5475624df454d88f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454d888 expref: 17 pid: 17167 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045541.038190:0:18326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18326:1870706873916416:0@lo:104: 00000100:00100000:2.0:1784045541.038269:0:18326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045541.038325:0:18326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b81986e00/0x5475624df454d78c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454d785 expref: 17 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045541.038333:0:18326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939b81986e00/0x5475624df454d78c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454d785 expref: 17 pid: 17167 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045541.038339:0:18326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18326:1870706873916544:0@lo:104: 00000100:00100000:2.0:1784045541.038424:0:18326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045541.038441:0:18326:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a60a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784045541.038760:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873916416 00000100:00100000:1.0:1784045541.038769:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873916416 00000100:00100000:1.0:1784045541.038819:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873916544 00000100:00100000:1.0:1784045541.038823:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873916544 00000100:00100000:1.0:1784045541.038840:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045541.038850:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+4:18326:x1870706873916416:12345-0@lo:104: 00010000:00010000:1.0:1784045541.038871:0:17155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d88f expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.038937:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045541.038944:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+4:18326:x1870706873916416:12345-0@lo:104: Request processed in 95us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045541.038953:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045541.038979:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784045541.038987:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+3:18326:x1870706873916544:12345-0@lo:104: 00010000:00010000:1.0:1784045541.038995:0:17155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d78c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.039032:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784045541.039037:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+3:18326:x1870706873916544:12345-0@lo:104: Request processed in 52us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045541.039043:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1784045541.039070:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045541.039078:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d88f expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.039087:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3200 already unused, calling callback (ffffffffc13c0c20) 00000100:00100000:2.0:1784045541.039092:0:18326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18326:1870706873916416:0@lo:104: 10000000:00010000:1.0:1784045541.039093:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454d88f expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045541.039105:0:18326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18326:1870706873916544:0@lo:104: 00010000:00010000:1.0:1784045541.039107:0:17160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454d88f expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045541.039117:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454d88f expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045541.039129:0:18326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045541.039130:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784045541.039173:0:17160:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d88f expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.039181:0:17160:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045541.039205:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d88f expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.039213:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c918b3200/0x5475624df454d888 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d88f expref: -99 pid: 17904 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.039226:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045541.039229:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d78c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.039235:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986200 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045541.039238:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454d78c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.039245:0:17160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454d78c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045541.039252:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454d78c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045541.039257:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784045541.039270:0:17160:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d78c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.039275:0:17160:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045541.039297:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d78c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.039304:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81986200/0x5475624df454d785 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d78c expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.039320:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045541.039322:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045541.039323:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045541.039333:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045541.039346:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873916672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045541.039378:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045541.039408:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045541.039416:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c25407c2-0928-423d-881e-1585e6e3cc3c:3626:1870706873916800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045541.039433:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045541.039467:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873916672 00000100:00100000:1.0:1784045541.039470:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873916672 00010000:00010000:1.0:1784045541.039486:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b836ccc00/0x5475624df454d88f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d888 expref: 18 pid: 17167 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045541.039499:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873916800 00000100:00100000:1.0:1784045541.039515:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873916800 00010000:00010000:1.0:1784045541.039526:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b81986e00/0x5475624df454d78c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d785 expref: 19 pid: 17167 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045541.039548:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045541.039554:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c25407c2-0928-423d-881e-1585e6e3cc3c+19:3623:x1870706873916672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045541.039567:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045541.039572:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b836ccc00/0x5475624df454d88f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d888 expref: 19 pid: 17167 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.039593:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b836ccc00/0x5475624df454d88f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454d888 expref: 19 pid: 17167 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.039609:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b836ccc00/0x5475624df454d88f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454d888 expref: 19 pid: 17167 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045541.039622:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045541.039650:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:3623:x1870706873916672:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (272us total) trans 0 rc 0/0 00010000:00010000:0.0:1784045541.039883:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045541.039897:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045541.039908:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+18:3626:x1870706873916800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045541.039918:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045541.039923:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b81986e00/0x5475624df454d78c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d785 expref: 18 pid: 17167 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045541.039933:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b81986e00/0x5475624df454d78c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454d785 expref: 18 pid: 17167 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045541.039943:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81986e00/0x5475624df454d78c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454d785 expref: 18 pid: 17167 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045541.039956:0:17157:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045541.039965:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045541.039980:0:17157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045541.039994:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045541.040003:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045541.040011:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045541.040017:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987400 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:0.0:1784045541.040022:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045541.040030:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045541.040053:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045541.040063:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045541.040101:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+17:3626:x1870706873916800:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045541.040179:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1784045541.040237:0:18326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045541.040246:0:18326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045541.040252:0:18326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81987400/0x5475624df454d8e3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045541.040334:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c25407c2-0928-423d-881e-1585e6e3cc3c:3626:1870706873916800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045541.041871:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045541.043170:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873916672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045541.399455:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784045542.361058:0:17169:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784045542.361067:0:17169:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939c92653800 from 13 10000000:01000000:0.0:1784045542.361072:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784045542.361121:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045542.361145:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045542.361166:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045542.361194:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873916928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784045542.361267:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045542.361322:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a7a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045542.361801:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873916928 00000100:00100000:1.0:1784045542.361810:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873916928 00000100:00100000:1.0:1784045542.361865:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784045542.361874:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+16:17169:x1870706873916928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045542.361887:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045542.361903:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b836cd600/0x5475624df454d8f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d8ea expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045542.361927:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836cd600/0x5475624df454d8f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d8ea expref: 17 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045542.361949:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b836cd600/0x5475624df454d8f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d8ea expref: 17 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045542.361959:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cd600, rc 0) 00000100:00100000:1.0:1784045542.362340:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17169:x1870706873916928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 466us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045542.362355:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784045542.363314:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873916928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045542.363339:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d8f1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045542.363351:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d8f1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045542.363472:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873917056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045542.363528:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045542.363566:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a7a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045542.363699:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873917056 00000100:00100000:1.0:1784045542.363705:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873917056 00000100:00100000:1.0:1784045542.363747:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784045542.363755:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17169:x1870706873917056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045542.363880:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17169:x1870706873917056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045542.363887:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784045542.363924:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873917056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045542.364230:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873917184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045542.364280:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045542.364301:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c82469e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784045542.364314:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873917184 00000100:00100000:1.0:1784045542.364318:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873917184 00000100:00100000:1.0:1784045542.364338:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784045542.364344:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17169:x1870706873917184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045542.365355:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17169:x1870706873917184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1006us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045542.365364:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784045542.366571:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873917184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784045542.370190:0:18378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784045542.370503:0:17169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784045542.370528:0:17169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784045542.370538:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d8f1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045542.370569:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d8f1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045542.370580:0:17169:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784045542.370582:0:17169:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939b840c4000 from 13 10000000:01000000:1.0:1784045542.370585:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784045542.370623:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045542.370636:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045542.370647:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045542.370672:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873917312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045542.370735:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045542.370777:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045542.370850:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873917312 00000100:00100000:3.0:1784045542.370857:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873917312 00000100:00100000:3.0:1784045542.370899:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784045542.370907:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+17:17169:x1870706873917312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045542.370918:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045542.370931:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c93632a00/0x5475624df454d8ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d8f8 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045542.370952:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c93632a00/0x5475624df454d8ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d8f8 expref: 18 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045542.370962:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c93632a00/0x5475624df454d8ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d8f8 expref: 18 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045542.370970:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93632a00, rc 0) 00000100:00100000:3.0:1784045542.371017:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17169:x1870706873917312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045542.371023:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784045542.371271:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873917312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045542.371285:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d8ff expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045542.371294:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d8ff expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045542.371348:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873917440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045542.371375:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045542.371419:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045542.371584:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873917440 00000100:00100000:3.0:1784045542.371590:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873917440 00000100:00100000:3.0:1784045542.371620:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784045542.371627:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17169:x1870706873917440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045542.371803:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17169:x1870706873917440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045542.371811:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784045542.371902:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873917440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045542.371931:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873917568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045542.371969:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045542.371994:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b828c99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045542.372046:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873917568 00000100:00100000:3.0:1784045542.372050:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873917568 00000100:00100000:3.0:1784045542.372090:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784045542.372096:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17169:x1870706873917568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045542.372172:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+18:17169:x1870706873917568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045542.372178:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784045542.372306:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873917568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784045542.373635:0:18379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784045542.379054:0:17169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784045542.379094:0:17169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784045542.379107:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d8ff expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045542.379120:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d8ff expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045542.419677:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784045542.997226:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784045543.061614:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045533/real 1784045533] req@ffff939cbf4cf100 x1870706873911808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045543 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045543.061665:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939cbf4cf100 x1870706873911808/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045543 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045543.061679:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045533/real 1784045533] req@ffff939cbf4cce00 x1870706873911680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045543 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045543.061691:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939cbf4cce00 x1870706873911680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045543 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784045543.061720:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb59c2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045543.061742:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784045543.061747:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873911808:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1784045543.061754:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb59c6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045543.061761:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784045543.061764:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873911680:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1784045543.061862:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045543.061869:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784045543.061875:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1784045543.061875:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c25407c2-0928-423d-881e-1585e6e3cc3c:3626:1870706873917696:0@lo:400:kworker.0 00000100:00080000:2.0:1784045543.061886:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784045543.061912:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045543.061915:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784045543.061918:0:8:0:(import.c:65:import_set_state_nolock()) ffff939cb59c6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784045543.061926:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 489 00000100:00080000:2.0:1784045543.061932:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784045543.061939:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff939cb59c6800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045543.061965:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939cbf4ce680 x1870706873918208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784045543.061967:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873918080:0@lo:400:kworker.0 00000100:00100000:1.0:1784045543.061983:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784045543.062004:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045543.062008:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784045543.062011:0:8:0:(import.c:65:import_set_state_nolock()) ffff939cb59c2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784045543.062015:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 489 00000100:00080000:2.0:1784045543.062019:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784045543.062024:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939cb59c2000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045543.062030:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045543.062040:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939cbf4cfb80 x1870706873918336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784045543.062067:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045543.062081:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873918464:0@lo:400:kworker.0 00000100:00100000:2.0:1784045543.062100:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873917824:0@lo:400:kworker.0 00000100:00100000:2.0:1784045543.062180:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045543.062232:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045543.062238:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873917952:0@lo:400:kworker.0 00000100:00100000:2.0:1784045543.062263:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045543.062293:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873917696 00000100:00100000:3.0:1784045543.062305:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873917696 00000100:00100000:1.0:1784045543.063270:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873918080 00000100:00100000:1.0:1784045543.063279:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873918080 00000100:00100000:1.0:1784045543.063325:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873917824 00000100:00100000:1.0:1784045543.063328:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873917824 00000100:00100000:1.0:1784045543.063348:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784045543.063371:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873918080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045543.067395:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784045543.067671:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+18:3626:x1870706873917696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045543.072204:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873918080:12345-0@lo:400:kworker.0 Request processed in 8818us (10160us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045543.072226:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784045543.072287:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784045543.072316:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1870706873917824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045543.075982:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1870706873917824:12345-0@lo:400:kworker.0 Request processed in 3657us (13787us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045543.076004:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784045543.076086:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873917824:0@lo:400:kworker.0 00000100:00100000:2.0:1784045543.076142:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873917952 00000100:00100000:2.0:1784045543.076148:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873917952 00000100:00100000:2.0:1784045543.076214:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784045543.076224:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873917952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045543.076302:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873917952:12345-0@lo:400:kworker.0 Request processed in 79us (14037us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045543.076309:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784045543.076502:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939cbf4ce300 x1870706873917952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045543.076514:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873917952:0@lo:400:kworker.0 00000100:00100000:3.0:1784045543.078246:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+18:3626:x1870706873917696:12345-0@lo:400:kworker.0 Request processed in 10823us (16258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045543.078263:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784045543.079370:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873918208:0@lo:8:kworker.0 00000400:00000100:3.0:1784045543.079520:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706873918208 offset 0 length 520: 4 00000100:00100000:3.0:1784045543.079565:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873918336:0@lo:8:kworker.0 00000400:00000100:3.0:1784045543.079583:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706873918336 offset 0 length 520: 4 00000100:00100000:3.0:1784045543.079637:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c25407c2-0928-423d-881e-1585e6e3cc3c:3626:1870706873917696:0@lo:400:kworker.0 00000100:00100000:3.0:1784045543.079668:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045543.079706:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873918080:0@lo:400:kworker.0 00000100:00100000:0.0:1784045543.082245:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873918464 00000100:00100000:0.0:1784045543.082260:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873918464 00000100:00100000:0.0:1784045543.082383:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045543.082395:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873918464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045543.082538:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873918464:12345-0@lo:400:kworker.0 Request processed in 145us (2868us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045543.082557:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1784045543.086973:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939cbf4cca80 x1870706873918464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045543.086997:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873918464:0@lo:400:kworker.0 00010000:00010000:2.0:1784045543.444590:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045544.083730:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873918592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045544.083801:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045544.084039:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873918592 00000100:00100000:1.0:1784045544.084048:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873918592 00000100:00100000:1.0:1784045544.084102:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784045544.084112:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873918592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045544.084156:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784045544.084258:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873918592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045544.084267:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784045544.085295:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873918592:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045544.085689:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045544.085700:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873918720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784045544.085763:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045544.086066:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873918720 00000100:00100000:1.0:1784045544.086072:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873918720 00000100:00100000:1.0:1784045544.086114:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784045544.086122:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1870706873918720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784045544.086248:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784045544.086434:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1870706873918720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 312us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045544.086466:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784045544.089687:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873918720:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1784045544.469075:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045545.108003:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045530/real 1784045530] req@ffff939b82881180 x1870706873909760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045545 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045545.108032:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939b82881180 x1870706873909760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045545 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045545.108043:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045530/real 1784045530] req@ffff939b82881c00 x1870706873909888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045545 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045545.108054:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939b82881c00 x1870706873909888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045545 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784045545.108074:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c937be000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784045545.108087:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784045545.108091:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873909760:0@lo:8:kworker.0 00000100:00080000:0.0:1784045545.108097:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb5a99000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784045545.108101:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784045545.108104:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873909888:0@lo:8:kworker.0 00000100:00080000:2.0:1784045545.108294:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045545.108298:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784045545.108302:0:37:0:(import.c:65:import_set_state_nolock()) ffff939c937be000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784045545.108307:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:2.0:1784045545.108312:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784045545.108320:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939c937be000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045545.108339:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939cbf4cc000 x1870706873919104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045545.108354:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045545.108357:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784045545.108374:0:37:0:(import.c:65:import_set_state_nolock()) ffff939cb5a99000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784045545.108378:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:2.0:1784045545.108381:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784045545.108386:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939cb5a99000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045545.108401:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939cbf4cca80 x1870706873919232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045545.108431:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045545.108435:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784045545.108438:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045545.108441:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784045545.108623:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873918848:0@lo:400:kworker.0 00000100:00100000:2.0:1784045545.108687:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045545.108869:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873919616:0@lo:400:kworker.0 00000100:00100000:2.0:1784045545.108901:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045545.108927:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045545.108934:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873918976:0@lo:400:kworker.0 00000100:00100000:2.0:1784045545.108961:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045545.108991:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873919616 00000100:00100000:2.0:1784045545.108998:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873919616 00000100:00100000:2.0:1784045545.109041:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784045545.109049:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873919616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045545.109097:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873919616:12345-0@lo:400:kworker.0 Request processed in 49us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045545.109105:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784045545.109326:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939cbf4cce00 x1870706873919616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045545.109338:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873919616:0@lo:400:kworker.0 00000100:00100000:3.0:1784045545.109623:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873919360:0@lo:400:kworker.0 00000100:00100000:3.0:1784045545.109659:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045545.109678:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784045545.109693:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873919488:0@lo:400:kworker.0 00000100:00100000:3.0:1784045545.109730:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045545.109769:0:17913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873918976 00000100:00100000:3.0:1784045545.109773:0:17913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873918976 00000100:00100000:3.0:1784045545.109801:0:17913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873919488 00000100:00100000:3.0:1784045545.109805:0:17913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873919488 00000100:00100000:3.0:1784045545.109819:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784045545.109826:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1870706873918976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045545.109869:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1870706873918976:12345-0@lo:400:kworker.0 Request processed in 43us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045545.109876:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784045545.109889:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784045545.109895:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873919488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045545.109923:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873919488:12345-0@lo:400:kworker.0 Request processed in 29us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045545.109929:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784045545.109953:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873919488:0@lo:400:kworker.0 00000100:00100000:3.0:1784045545.109971:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873918976:0@lo:400:kworker.0 00000100:00100000:2.0:1784045545.110354:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873919360 00000100:00100000:2.0:1784045545.110358:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873919360 00000100:00100000:2.0:1784045545.110395:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784045545.110403:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873919360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045545.110440:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873919360:12345-0@lo:400:kworker.0 Request processed in 38us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045545.110470:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784045545.110700:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873918848 00000100:00100000:0.0:1784045545.110713:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873918848 00000100:00100000:0.0:1784045545.110753:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784045545.110760:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:3625:x1870706873918848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045545.110803:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+18:3625:x1870706873918848:12345-0@lo:400:kworker.0 Request processed in 43us (2116us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045545.110822:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784045545.110863:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873919104:0@lo:8:kworker.0 00000400:00000100:0.0:1784045545.110888:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706873919104 offset 0 length 520: 4 00000100:00100000:0.0:1784045545.110912:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873919232:0@lo:8:kworker.0 00000400:00000100:0.0:1784045545.110930:0:3622:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870706873919232 offset 0 length 520: 4 00000100:00100000:0.0:1784045545.110964:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873918848:0@lo:400:kworker.0 00010000:00080000:3.0:1784045545.111201:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939cbf4cd180 x1870706873919360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045545.111212:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873919360:0@lo:400:kworker.0 00000001:00100000:0.0:1784045545.115174:0:17905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1784045545.503363:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784045545.947052:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784045546.517247:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045547.540641:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045548.564135:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784045549.129052:0:18676:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784045549.129057:0:18676:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1784045549.129058:0:18676:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1784045549.129171:0:18676:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff939cb658c000 00000020:01000004:3.0:1784045549.129189:0:18676:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1784045549.129204:0:18676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784045549.129236:0:18676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff939b819b19c0) 00000020:00000080:3.0:1784045549.129254:0:18676:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00000100:00100000:2.0:1784045549.203922:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045549.203943:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873919744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045549.204020:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045549.204176:0:17913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873919744 00000100:00100000:1.0:1784045549.204184:0:17913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873919744 00000100:00100000:1.0:1784045549.204241:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784045549.204250:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873919744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784045549.204282:0:17913:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784045549.204328:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873919744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045549.204335:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784045549.204475:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045549.204485:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873919872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045549.204525:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045549.204555:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873919872 00000100:00100000:3.0:1784045549.204559:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873919872 00000100:00100000:3.0:1784045549.204585:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784045549.204591:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873919872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784045549.204609:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784045549.204655:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873919872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045549.204661:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784045549.204700:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873919872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045549.205201:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873919744:0@lo:41:osp-pre-1-0.0 00100000:10000000:0.0:1784045549.215929:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784045549.237434:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784045549.238836:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784045549.239483:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1784045549.241586:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784045549.242140:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1784045549.244192:0:18676:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1784045549.245925:0:18676:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784045549.246407:0:18676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1784045549.246422:0:18676:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784045549.246435:0:18676:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5475624df454d90d 00000020:01000004:3.0:1784045549.246852:0:18676:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1784045549.246883:0:18676:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.144@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784045549.246888:0:18676:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784045549.246896:0:18676:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1784045549.246915:0:18676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1784045549.246930:0:18676:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff939b819b3380) 00000020:00000080:3.0:1784045549.246945:0:18676:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1784045549.250678:0:18676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784045549.250875:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1784045549.250881:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1784045549.259441:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1784045549.259484:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1784045549.262332:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1784045549.262343:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1784045549.264568:0:18676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784045549.265418:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1784045549.265427:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1784045549.269723:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1784045549.269735:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1784045549.321916:0:18676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784045549.322381:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784045549.322389:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1784045549.324259:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784045549.324272:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1784045549.325819:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784045549.325831:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1784045549.328379:0:18676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784045549.331921:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1784045549.331932:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1784045549.334377:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1784045549.334391:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1784045549.393764:0:18676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784045549.394079:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1784045549.394087:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1784045549.397584:0:18676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1784045549.397602:0:18676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1784045549.398273:0:18676:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1784045549.398305:0:18676:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1784045549.398312:0:18676:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1784045549.421922:0:18676:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784045549.421964:0:18676:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.144@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1784045549.421969:0:18676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784045549.421971:0:18676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784045549.421972:0:18676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045549.421974:0:18676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045549.421980:0:18676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045549.421981:0:18676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045549.421994:0:18676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045549.421996:0:18676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045549.421997:0:18676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784045549.422001:0:18676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1784045549.422003:0:18676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784045549.422004:0:18676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784045549.422005:0:18676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045549.422006:0:18676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045549.422007:0:18676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045549.422008:0:18676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045549.422009:0:18676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045549.422009:0:18676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045549.422010:0:18676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784045549.422050:0:18676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784045549.422070:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920000:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784045549.422138:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045549.422187:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c982a4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784045549.422259:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873920000 00000100:00100000:3.0:1784045549.422267:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873920000 00000100:00100000:3.0:1784045549.422322:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784045549.422331:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+18:18676:x1870706873920000:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784045549.422372:0:17166:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784045549.422375:0:17166:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1784045549.422380:0:17166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1784045549.423010:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+18:18676:x1870706873920000:12345-0@lo:253:mount.lustre.0 Request processed in 676us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045549.423019:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784045549.423135:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920000:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784045549.423147:0:18676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784045549.423149:0:18676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784045549.423150:0:18676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784045549.423151:0:18676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045549.423153:0:18676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045549.423154:0:18676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045549.423155:0:18676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045549.423156:0:18676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045549.423157:0:18676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045549.423159:0:18676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784045549.423190:0:18676:0:(tgt_mount.c:101:server_register_mount()) register mount ffff939cb658c000 from lustre-OST0000 10000000:01000000:0.0:1784045549.423216:0:18676:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1784045549.423219:0:18676:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784045549.423226:0:18676:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff939b832619c0 local copy 00010000:00010000:0.0:1784045549.423237:0:18676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6cf expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045549.423360:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045549.423393:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045549.423432:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c982a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784045549.423532:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873920128 00000100:00100000:2.0:1784045549.423538:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873920128 00000100:00100000:2.0:1784045549.423592:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784045549.423601:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+18:18676:x1870706873920128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045549.423673:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+18:18676:x1870706873920128:12345-0@lo:501:mount.lustre.0 Request processed in 74us (279us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784045549.423680:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784045549.423759:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91561880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920128:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784045549.423772:0:18676:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784045549.423791:0:18676:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784045549.423797:0:18676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6cf expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045549.423812:0:18676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6cf expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045549.423840:0:18676:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff939cb658c000 10000000:01000000:3.0:1784045549.423844:0:18676:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784045549.423849:0:18676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784045549.423852:0:18676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784045549.423856:0:18676:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784045549.423858:0:18676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784045549.423880:0:18676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93632800/0x5475624df454d91b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045549.423888:0:18676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c93632800/0x5475624df454d91b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045549.423897:0:18676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c93632800/0x5475624df454d91b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045549.423911:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784045549.423941:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045549.423968:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1784045549.424198:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873920256 00000100:00100000:2.0:1784045549.424202:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873920256 00000100:00100000:2.0:1784045549.424234:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784045549.424241:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+18:18676:x1870706873920256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045549.424250:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045549.424267:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81986600/0x5475624df454d922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d91b expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045549.424287:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986600/0x5475624df454d922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d91b expref: 19 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045549.424297:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81986600/0x5475624df454d922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d91b expref: 19 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045549.424305:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986600, rc 0) 00000100:00100000:2.0:1784045549.424335:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+19:18676:x1870706873920256:12345-0@lo:101:mount.lustre.0 Request processed in 95us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045549.424341:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784045549.424591:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045549.424605:0:18676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c93632800/0x5475624df454d91b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d922 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045549.424613:0:18676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c93632800/0x5475624df454d91b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d922 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784045549.427967:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1784045549.428933:0:18676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784045549.429348:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1784045549.429375:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1784045549.429389:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1784045549.429402:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1784045549.429415:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1784045549.429428:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1784045549.429849:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1784045549.429861:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1784045549.430221:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045549.430291:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045549.430394:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2840 going to sleep for 11 seconds 00000100:00100000:2.0:1784045549.432180:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873920384 00000100:00100000:2.0:1784045549.432193:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873920384 00000100:00100000:2.0:1784045549.432305:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784045549.432315:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+19:18676:x1870706873920384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045549.432548:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+19:18676:x1870706873920384:12345-0@lo:501:mount.lustre.0 Request processed in 234us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045549.432557:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784045549.432657:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045549.432702:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920512:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784045549.432770:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045549.433955:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2840 going to sleep for 11 seconds 00000100:00100000:0.0:1784045549.435872:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873920512 00000100:00100000:0.0:1784045549.435885:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873920512 00000100:00100000:0.0:1784045549.435944:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784045549.435954:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+19:18676:x1870706873920512:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784045549.437103:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+19:18676:x1870706873920512:12345-0@lo:503:mount.lustre.0 Request processed in 1146us (4328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045549.437113:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784045549.437229:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920512:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784045549.437736:0:18676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784045549.437826:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045549.437876:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045549.437910:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2240 going to sleep for 11 seconds 00000100:00100000:0.0:1784045549.438258:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873920640 00000100:00100000:0.0:1784045549.438265:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873920640 00000100:00100000:0.0:1784045549.438298:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784045549.438306:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+19:18676:x1870706873920640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045549.438919:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+19:18676:x1870706873920640:12345-0@lo:502:mount.lustre.0 Request processed in 611us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045549.438927:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784045549.439048:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784045549.439271:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1784045549.439304:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1784045549.439604:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1784045549.439625:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1784045549.439638:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1784045549.439667:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1784045549.439681:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1784045549.439693:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1784045549.439705:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1784045549.439881:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1784045549.439896:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1784045549.439909:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1784045549.439944:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045549.440130:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045549.440172:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2240 going to sleep for 11 seconds 00000100:00100000:2.0:1784045549.440244:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873920768 00000100:00100000:2.0:1784045549.440251:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873920768 00000100:00100000:2.0:1784045549.440292:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784045549.440299:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+19:18676:x1870706873920768:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045549.440417:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+19:18676:x1870706873920768:12345-0@lo:502:mount.lustre.0 Request processed in 118us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045549.440424:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784045549.440628:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784045549.440676:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1784045549.440687:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1784045549.441917:0:18693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784045549.441926:0:18693:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1784045549.441945:0:18693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045549.441948:0:18693:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784045549.441954:0:18693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784045549.441969:0:18693:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff939b819b4d40) 00000020:00000080:3.0:1784045549.441992:0:18693:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784045549.441998:0:18693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784045549.442089:0:18693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939cb658c000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784045549.442097:0:18693:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784045549.442104:0:18693:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5475624df454d930 00010000:00010000:3.0:1784045549.446977:0:18693:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1784045549.450662:0:18693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1784045549.460573:0:18693:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1784045549.462743:0:18693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1784045549.462761:0:18693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045549.462768:0:18693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045549.462770:0:18693:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1784045549.462781:0:18693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784045549.462785:0:18693:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1784045549.462786:0:18693:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784045549.462788:0:18693:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784045549.462789:0:18693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784045549.462792:0:18693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045549.462794:0:18693:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784045549.462796:0:18693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045549.462799:0:18693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045549.462800:0:18693:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784045549.462803:0:18693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784045549.462805:0:18693:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784045549.462807:0:18693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045549.462810:0:18693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045549.462811:0:18693:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784045549.462813:0:18693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784045549.462815:0:18693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045549.462817:0:18693:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784045549.462820:0:18693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1784045549.462851:0:18693:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784045549.462854:0:18693:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784045549.462856:0:18693:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784045549.462858:0:18693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1784045549.464259:0:18676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1784045549.464303:0:18676:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784045549.464334:0:18676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93632800/0x5475624df454d91b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d922 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045549.464347:0:18676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c93632800/0x5475624df454d91b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d922 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045549.464356:0:18676:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939cb658c000 from 1 10000000:01000000:0.0:1784045549.464373:0:18676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784045549.464410:0:18676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045549.464418:0:18676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045549.464429:0:18676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045549.464637:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784045549.464704:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045549.465129:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c982a46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045549.467196:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873920896 00000100:00100000:0.0:1784045549.467210:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873920896 00000100:00100000:0.0:1784045549.467281:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784045549.467292:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+19:18676:x1870706873920896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045549.467309:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045549.467334:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c918b2e00/0x5475624df454d93e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d937 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045549.467362:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c918b2e00/0x5475624df454d93e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d937 expref: 20 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045549.467374:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c918b2e00/0x5475624df454d93e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d937 expref: 20 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045549.467383:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b2e00, rc 0) 00000100:00100000:0.0:1784045549.467492:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+20:18676:x1870706873920896:12345-0@lo:101:mount.lustre.0 Request processed in 202us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045549.467519:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784045549.467638:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873920896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045549.467657:0:18676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d93e expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045549.467667:0:18676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d93e expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784045549.469609:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1784045549.469921:0:18676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784045549.470370:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1784045549.470395:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1784045549.470412:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1784045549.470418:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1784045549.470677:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045549.470737:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045549.470854:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f2540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045549.478229:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873921024 00000100:00100000:1.0:1784045549.478244:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873921024 00000100:00100000:1.0:1784045549.478380:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784045549.478392:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+20:18676:x1870706873921024:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045549.478620:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+20:18676:x1870706873921024:12345-0@lo:501:mount.lustre.0 Request processed in 231us (7881us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045549.478627:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784045549.478750:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045549.478825:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045549.478871:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045549.484586:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b8195c000 going to sleep for 11 seconds 00000100:00100000:0.0:1784045549.484675:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873921152 00000100:00100000:0.0:1784045549.484685:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873921152 00000100:00100000:0.0:1784045549.484739:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784045549.484749:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+20:18676:x1870706873921152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784045549.485154:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+20:18676:x1870706873921152:12345-0@lo:503:mount.lustre.0 Request processed in 406us (6282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045549.485164:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784045549.485322:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921152:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784045549.493269:0:18676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784045549.493383:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045549.493486:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045549.493528:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b8195c000 going to sleep for 11 seconds 00000100:00100000:0.0:1784045549.494384:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873921280 00000100:00100000:0.0:1784045549.494393:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873921280 00000100:00100000:0.0:1784045549.494477:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784045549.494487:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+20:18676:x1870706873921280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045549.494622:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+20:18676:x1870706873921280:12345-0@lo:502:mount.lustre.0 Request processed in 137us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045549.494631:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784045549.495192:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784045549.495682:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1784045549.495902:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1784045549.495921:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1784045549.495933:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1784045549.495944:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1784045549.495955:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1784045549.495967:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1784045549.495980:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1784045549.496168:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1784045549.496183:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1784045549.496196:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1784045549.496236:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045549.496296:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045549.496494:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b8195c000 going to sleep for 11 seconds 00000100:00100000:3.0:1784045549.496605:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873921408 00000100:00100000:3.0:1784045549.496612:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873921408 00000100:00100000:0.0:1784045549.501202:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784045549.501228:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+20:18676:x1870706873921408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045549.501432:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+20:18676:x1870706873921408:12345-0@lo:502:mount.lustre.0 Request processed in 216us (5133us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045549.501441:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784045549.501641:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784045549.501742:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1784045549.501757:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1784045549.503133:0:18697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045549.503144:0:18697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045549.503146:0:18697:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784045549.503160:0:18697:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939cb658c000 00000020:00000080:1.0:1784045549.503163:0:18697:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784045549.503170:0:18697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045549.503172:0:18697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045549.503174:0:18697:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784045549.503177:0:18697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045549.503179:0:18697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045549.503180:0:18697:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784045549.503183:0:18697:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939cb658c000 00000020:00000080:1.0:1784045549.503185:0:18697:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784045549.503239:0:18697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045549.505599:0:18697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045549.505607:0:18697:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784045549.505617:0:18697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045549.505624:0:18697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045549.505626:0:18697:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784045549.505631:0:18697:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939cb658c000 00000020:00000080:0.0:1784045549.505642:0:18697:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784045549.505692:0:18697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045549.505696:0:18697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045549.505697:0:18697:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784045549.505700:0:18697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045549.505702:0:18697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045549.505703:0:18697:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784045549.505717:0:18697:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939cb658c000 00000020:00000080:0.0:1784045549.505719:0:18697:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784045549.505765:0:18697:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045549.505769:0:18697:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045549.505770:0:18697:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784045549.505782:0:18697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1784045549.506643:0:18676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1784045549.506680:0:18676:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784045549.506745:0:18676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d93e expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.506759:0:18676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d93e expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045549.506837:0:18676:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784045549.506841:0:18676:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff939cb658c000 10000000:01000000:1.0:1784045549.506845:0:18676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff939cb658c000 10000000:01000000:1.0:1784045549.506849:0:18676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784045549.506856:0:18676:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939cb658c000 from 1 10000000:01000000:1.0:1784045549.506859:0:18676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784045549.506899:0:18676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cc000/0x5475624df454d945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.506908:0:18676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b836cc000/0x5475624df454d945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.506919:0:18676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b836cc000/0x5475624df454d945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045549.506958:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784045549.507194:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045549.507236:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a49900 going to sleep for 11 seconds 00000100:00100000:1.0:1784045549.507266:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873921536 00000100:00100000:1.0:1784045549.507272:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873921536 00000100:00100000:1.0:1784045549.507315:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784045549.507335:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+20:18676:x1870706873921536:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045549.507349:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045549.507364:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b836cdc00/0x5475624df454d94c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d945 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.507388:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836cdc00/0x5475624df454d94c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d945 expref: 21 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.507400:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b836cdc00/0x5475624df454d94c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d945 expref: 21 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.507409:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cdc00, rc 0) 00000100:00100000:1.0:1784045549.507477:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+21:18676:x1870706873921536:12345-0@lo:101:mount.lustre.0 Request processed in 154us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045549.507485:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784045549.507539:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045549.507553:0:18676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b836cc000/0x5475624df454d945 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d94c expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.507561:0:18676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b836cc000/0x5475624df454d945 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d94c expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784045549.525581:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1784045549.525916:0:18676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784045549.526112:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1784045549.526137:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1784045549.526152:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1784045549.526164:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1784045549.526176:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1784045549.526189:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1784045549.526203:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1784045549.526216:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1784045549.526229:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1784045549.526241:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1784045549.526254:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1784045549.526266:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1784045549.526279:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1784045549.526292:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1784045549.526304:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1784045549.526351:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1784045549.526369:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1784045549.526381:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1784045549.526393:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1784045549.526406:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1784045549.526430:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1784045549.526490:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1784045549.526509:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1784045549.526524:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1784045549.526537:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1784045549.526549:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1784045549.526560:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1784045549.526573:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1784045549.526586:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1784045549.526598:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1784045549.526612:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1784045549.526639:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1784045549.526655:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1784045549.526666:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1784045549.526679:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1784045549.526692:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1784045549.526705:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1784045549.526724:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1784045549.526729:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1784045549.526813:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045549.526878:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045549.526932:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045549.527468:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873921664 00000100:00100000:1.0:1784045549.527476:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873921664 00000100:00100000:1.0:1784045549.527525:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784045549.527534:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+21:18676:x1870706873921664:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045549.527678:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+21:18676:x1870706873921664:12345-0@lo:501:mount.lustre.0 Request processed in 144us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045549.527685:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784045549.533637:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045549.533693:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784045549.533760:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045549.533810:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045549.533887:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873921792 00000100:00100000:2.0:1784045549.533894:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873921792 00000100:00100000:2.0:1784045549.533948:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784045549.533957:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+21:18676:x1870706873921792:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045549.534075:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+21:18676:x1870706873921792:12345-0@lo:503:mount.lustre.0 Request processed in 118us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045549.534082:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784045549.534398:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921792:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784045549.535592:0:18676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784045549.535678:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045549.535762:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045549.535816:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c885f23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045549.536051:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873921920 00000100:00100000:2.0:1784045549.536058:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873921920 00000100:00100000:2.0:1784045549.536104:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784045549.536112:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:18676:x1870706873921920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045549.536219:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:18676:x1870706873921920:12345-0@lo:502:mount.lustre.0 Request processed in 107us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045549.536226:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784045549.536642:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873921920:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784045549.542377:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1784045549.542503:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1784045549.542524:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1784045549.542543:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1784045549.542560:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1784045549.542574:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1784045549.542589:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1784045549.542605:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1784045549.542618:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1784045549.542635:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1784045549.542648:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1784045549.542665:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1784045549.542682:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1784045549.542698:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1784045549.542716:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1784045549.542732:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1784045549.542748:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1784045549.542764:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1784045549.542778:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1784045549.542789:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1784045549.542818:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1784045549.542830:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1784045549.542841:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1784045549.542856:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1784045549.542868:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1784045549.542879:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1784045549.542891:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1784045549.542901:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1784045549.543155:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1784045549.543178:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1784045549.543214:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1784045549.543230:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1784045549.543244:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1784045549.543383:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1784045549.543405:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1784045549.543425:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1784045549.543475:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1784045549.543498:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1784045549.543518:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1784045549.543538:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1784045549.543559:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1784045549.543580:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1784045549.543599:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1784045549.543617:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1784045549.543633:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1784045549.543650:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1784045549.543678:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1784045549.543695:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1784045549.543755:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873922048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045549.543833:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045549.544113:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c92daae40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045549.547628:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873922048 00000100:00100000:3.0:1784045549.547642:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873922048 00000100:00100000:3.0:1784045549.547721:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784045549.547731:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+21:18676:x1870706873922048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045549.547898:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+21:18676:x1870706873922048:12345-0@lo:502:mount.lustre.0 Request processed in 169us (4064us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045549.547907:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784045549.548033:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873922048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784045549.548285:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1784045549.548315:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1784045549.548360:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873922176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045549.548402:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045549.548440:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c87df7300 going to sleep for 11 seconds 00000100:00100000:3.0:1784045549.550693:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873922176 00000100:00100000:3.0:1784045549.550718:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873922176 00000100:00100000:3.0:1784045549.550786:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784045549.550795:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+21:18676:x1870706873922176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784045549.550935:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+21:18676:x1870706873922176:12345-0@lo:502:mount.lustre.0 Request processed in 142us (2533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045549.550944:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1784045549.551189:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873922176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784045549.551265:0:18676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1784045549.551280:0:18676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1784045549.552088:0:18701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784045549.552104:0:18701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff939b819b0000) 00000020:00000080:3.0:1784045549.552126:0:18701:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1784045549.552296:0:18701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939cb658c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784045549.552301:0:18701:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939cb658c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784045549.552304:0:18701:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939cb658c000 3 00010000:00080000:3.0:1784045549.552344:0:18701:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939b841f9000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1784045549.560052:0:18701:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1784045549.560172:0:18701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1784045549.560229:0:18701:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784045549.560252:0:18701:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5475624df454d95a 00000100:00080000:3.0:1784045549.560263:0:18701:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784045549.560269:0:18701:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff939b841f9000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045549.560305:0:18701:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82881180 x1870706873922304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045549.560634:0:18701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784045549.560708:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1870706873922304:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784045549.560772:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045549.560880:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873922304 00000100:00100000:3.0:1784045549.560888:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873922304 00000100:00100000:3.0:1784045549.560920:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784045549.560928:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873922304:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784045549.560950:0:17172:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:3.0:1784045549.561172:0:17172:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5475624df454d961 00000004:00100000:3.0:1784045549.561189:0:17172:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784045549.561220:0:17172:0:(import.c:65:import_set_state_nolock()) ffff939b841f8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045549.561281:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1870706873922304:12345-0@lo:38:llog_process_th.0 Request processed in 351us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045549.561290:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1784045549.561577:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045549.561583:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784045549.561587:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045549.561590:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1784045549.561612:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939b82881180 x1870706873922304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045549.561624:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784045549.561631:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045549.561632:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1784045549.561638:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784045549.561642:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784045549.561642:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784045549.561648:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784045549.561650:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784045549.561654:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b841f9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784045549.561663:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1870706873922304:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784045549.561708:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045549.561720:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873922432:0@lo:400:kworker.0 00000100:00100000:2.0:1784045549.561757:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045549.561794:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873922560:0@lo:400:kworker.0 00000100:00100000:2.0:1784045549.561822:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045549.561868:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873922432 00000100:00100000:3.0:1784045549.561874:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873922432 00000100:00100000:2.0:1784045549.561891:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873922560 00000100:00100000:2.0:1784045549.561894:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873922560 00000100:00100000:3.0:1784045549.561904:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045549.561910:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873922432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045549.561916:0:17174:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784045549.561922:0:17174:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1784045549.561954:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873922432:12345-0@lo:400:kworker.0 Request processed in 43us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045549.561961:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045549.561973:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784045549.561979:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873922560:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1784045549.562001:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939cb684b800 x1870706873922432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045549.562012:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873922432:0@lo:400:kworker.0 00000100:00100000:3.0:1784045549.562029:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873922560:12345-0@lo:400:kworker.0 Request processed in 49us (206us total) trans 0 rc 0/0 00010000:00080000:2.0:1784045549.562039:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939cb6849500 x1870706873922560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045549.562042:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045549.562047:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873922560:0@lo:400:kworker.0 00000020:01000004:0.0:1784045549.563896:0:18701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1784045549.563912:0:18701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff939cb59d0000) 00000020:00000080:0.0:1784045549.563935:0:18701:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1784045549.564098:0:18701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939cb658c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784045549.564103:0:18701:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939cb658c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784045549.564106:0:18701:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939cb658c000 3 00010000:00080000:0.0:1784045549.564134:0:18701:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939b82a1a800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.144@tcp at head 00010000:00010000:0.0:1784045549.567066:0:18701:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1784045549.567173:0:18701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1784045549.567215:0:18701:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784045549.567226:0:18701:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5475624df454d96f 00000100:00080000:0.0:1784045549.567235:0:18701:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784045549.567240:0:18701:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff939b82a1a800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045549.567276:0:18701:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939c91563100 x1870706873922688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784045549.567314:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1870706873922688:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784045549.567380:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784045549.567549:0:18701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1784045549.567605:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873922688 00000100:00100000:3.0:1784045549.567612:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873922688 00000100:00100000:3.0:1784045549.567644:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784045549.567651:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1870706873922688:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784045549.567676:0:17173:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:3.0:1784045549.567707:0:17173:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5475624df454d976 00000004:00100000:3.0:1784045549.567722:0:17173:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784045549.567754:0:17173:0:(import.c:65:import_set_state_nolock()) ffff939b841f8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045549.567821:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1870706873922688:12345-0@lo:38:llog_process_th.0 Request processed in 168us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045549.567829:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1784045549.567878:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff939c91563100 x1870706873922688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045549.567888:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784045549.567897:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1784045549.567903:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784045549.567907:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784045549.567910:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b82a1a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784045549.567915:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1870706873922688:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1784045549.568246:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045549.568252:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784045549.568255:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045549.568257:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784045549.568262:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045549.568265:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784045549.568267:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045549.568270:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1784045549.568349:0:18701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1784045549.568549:0:18676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784045549.568581:0:18676:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784045549.568634:0:18676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cc000/0x5475624df454d945 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d94c expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045549.568646:0:18676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b836cc000/0x5475624df454d945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d94c expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784045549.568703:0:18676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784045549.568706:0:18676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784045549.568707:0:18676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045549.568708:0:18676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045549.568709:0:18676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045549.568710:0:18676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045549.568711:0:18676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045549.568712:0:18676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045549.568713:0:18676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784045549.568716:0:18676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1784045549.568718:0:18676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784045549.568719:0:18676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784045549.568719:0:18676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045549.568723:0:18676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045549.568724:0:18676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045549.568725:0:18676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045549.568725:0:18676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045549.568726:0:18676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045549.568727:0:18676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784045549.568743:0:18676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784045549.568754:0:18676:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873922816:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784045549.568792:0:18676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045549.568826:0:18676:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c87df7240 going to sleep for 11 seconds 00000100:00100000:2.0:1784045549.568882:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873922816 00000100:00100000:2.0:1784045549.568887:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873922816 00000100:00100000:2.0:1784045549.568918:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784045549.568924:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:18676:x1870706873922816:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784045549.568941:0:17167:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784045549.568952:0:17167:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784045549.571698:0:17167:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784045549.571731:0:17167:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784045549.571888:0:17188:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784045549.571894:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784045549.571917:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.571935:0:17188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b81987c00/0x5475624df454d8c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d8c0 expref: 21 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.571943:0:17188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c918b3000/0x5475624df454d8d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d8ce expref: 21 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.571950:0:17188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.571988:0:17188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c918b3000/0x5475624df454d8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454d8ce expref: 21 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.572003:0:17188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939c918b3000/0x5475624df454d8d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454d8ce expref: 21 pid: 17164 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045549.572016:0:17188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873922944:0@lo:104: 00000100:00100000:3.0:1784045549.572058:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:18676:x1870706873922816:12345-0@lo:253:mount.lustre.0 Request processed in 3132us (3262us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045549.572070:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045549.572083:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:1.0:1784045549.572120:0:17188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b81987c00/0x5475624df454d8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454d8c0 expref: 20 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.572128:0:17188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939b81987c00/0x5475624df454d8c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454d8c0 expref: 20 pid: 17164 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045549.572137:0:17188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873923072:0@lo:104: 00000100:00100000:1.0:1784045549.572162:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045549.572180:0:18676:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:18676:1870706873922816:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784045549.572187:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c83d63b40 going to sleep for 11 seconds 10000000:01000000:2.0:1784045549.572193:0:18676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784045549.572197:0:18676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784045549.572199:0:18676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784045549.572201:0:18676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784045549.572203:0:18676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784045549.572204:0:18676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784045549.572206:0:18676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784045549.572207:0:18676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784045549.572209:0:18676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784045549.572210:0:18676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784045549.572213:0:17156:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000020:02000000:2.0:1784045549.572227:0:18676:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1784045549.572228:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873922944 00000100:00100000:1.0:1784045549.572235:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873922944 00000100:00100000:1.0:1784045549.572265:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873923072 00000100:00100000:1.0:1784045549.572268:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873923072 00000100:00100000:1.0:1784045549.572286:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045549.572294:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+4:17188:x1870706873922944:12345-0@lo:104: 00010000:00010000:1.0:1784045549.572307:0:17156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d8d5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.573170:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045549.573178:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+4:17188:x1870706873922944:12345-0@lo:104: Request processed in 884us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045549.573187:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045549.573213:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784045549.573222:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1045c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+3:17188:x1870706873923072:12345-0@lo:104: 00010000:00010000:1.0:1784045549.573232:0:17156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d8c7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.573283:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784045549.573288:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1045c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+3:17188:x1870706873923072:12345-0@lo:104: Request processed in 69us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045549.573295:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1784045549.573404:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045549.573410:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d8d5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.573418:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93632c00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045549.573422:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454d8d5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.573431:0:17160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454d8d5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045549.573438:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454d8d5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045549.573472:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045549.573504:0:17160:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d8d5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.573511:0:17160:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045549.573535:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d8d5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.573542:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c93632c00/0x5475624df454d8ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d8d5 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.573564:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045549.573568:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d8c7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.573573:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93633c00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045549.573575:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454d8c7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.573582:0:17160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454d8c7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045549.573588:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454d8c7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045549.573593:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045549.573607:0:17160:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d8c7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.573612:0:17160:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045549.573629:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d8c7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.573635:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c93633c00/0x5475624df454d8c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d8c7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.573648:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045549.573651:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045549.573654:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045549.573726:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045549.573747:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c25407c2-0928-423d-881e-1585e6e3cc3c:3626:1870706873923200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045549.573798:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045549.573850:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873923328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045549.573880:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045549.573923:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873923200 00000100:00100000:1.0:1784045549.573929:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873923200 00010000:00010000:1.0:1784045549.573952:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c918b3000/0x5475624df454d8d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d8ce expref: 21 pid: 17164 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045549.573976:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873923328 00000100:00100000:1.0:1784045549.573979:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873923328 00010000:00010000:1.0:1784045549.574007:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b81987c00/0x5475624df454d8c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d8c0 expref: 22 pid: 17164 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045549.574027:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045549.574034:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c25407c2-0928-423d-881e-1585e6e3cc3c+22:3626:x1870706873923200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045549.574044:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045549.574049:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c918b3000/0x5475624df454d8d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d8ce expref: 22 pid: 17164 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.574059:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c918b3000/0x5475624df454d8d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454d8ce expref: 22 pid: 17164 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.574073:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045549.574111:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c25407c2-0928-423d-881e-1585e6e3cc3c+22:3626:x1870706873923200:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045549.574118:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045549.574135:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784045549.574142:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b834cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:3623:x1870706873923328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045549.574156:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045549.574161:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b81987c00/0x5475624df454d8c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d8c0 expref: 21 pid: 17164 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.574171:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b81987c00/0x5475624df454d8c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454d8c0 expref: 21 pid: 17164 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.574184:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.574192:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784045549.574205:0:17159:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015662686s 00010000:00010000:1.0:1784045549.574210:0:17159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.574218:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.574225:0:17159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.574231:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.574237:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836ccc00 already unused, calling callback (ffffffffc0dc5230) 00000100:00100000:0.0:1784045549.574240:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c25407c2-0928-423d-881e-1585e6e3cc3c:3626:1870706873923200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045549.574243:0:17159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.574254:0:17159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.574270:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045549.574280:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045549.574316:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b834cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:3623:x1870706873923328:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045549.574332:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784045549.574353:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873923328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045549.574575:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c918b3000/0x5475624df454d8d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454d8ce expref: 20 pid: 17164 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045549.574588:0:17188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873922944:0@lo:104: 00010000:00010000:0.0:1784045549.574601:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81987c00/0x5475624df454d8c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454d8c0 expref: 19 pid: 17164 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045549.574611:0:17188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873923072:0@lo:104: 00010000:00010000:0.0:1784045549.574625:0:17188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045549.574634:0:17188:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045549.574640:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045549.574647:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b836ccc00/0x5475624df454d97d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1784045549.577228:0:18676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1784045549.581097:0:18676:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1784045549.581104:0:18676:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1784045549.581137:0:18676:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784045549.581177:0:18676:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784045549.581198:0:18676:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1784045549.581219:0:18676:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1784045549.581876:0:18676:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784045549.582078:0:18676:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784045549.592208:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045550.612112:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784045550.652919:0:18758:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784045550.653138:0:18758:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1784045551.197634:0:17169:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784045551.197643:0:17169:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939c92653800 from 9 10000000:01000000:2.0:1784045551.197649:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784045551.197699:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045551.197710:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045551.197721:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045551.197748:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873923456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784045551.197820:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045551.197867:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fd08b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045551.198321:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873923456 00000100:00100000:0.0:1784045551.198328:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873923456 00000100:00100000:0.0:1784045551.198391:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784045551.198400:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+19:17169:x1870706873923456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045551.198414:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045551.198430:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c918b3a00/0x5475624df454d98b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d984 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045551.198497:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c918b3a00/0x5475624df454d98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d984 expref: 20 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045551.198508:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c918b3a00/0x5475624df454d98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d984 expref: 20 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045551.198517:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b3a00, rc 0) 00000100:00100000:0.0:1784045551.198566:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+20:17169:x1870706873923456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045551.198572:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784045551.198978:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873923456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045551.198995:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d98b expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045551.199021:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d98b expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045551.199083:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873923584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784045551.199122:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045551.199143:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fd08b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045551.199162:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873923584 00000100:00100000:2.0:1784045551.199165:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873923584 00000100:00100000:2.0:1784045551.199194:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784045551.199200:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+20:17169:x1870706873923584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784045551.199217:0:17167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784045551.199234:0:17167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784045551.199237:0:17167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1784045551.199305:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+20:17169:x1870706873923584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045551.199311:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784045551.199343:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873923584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784045551.199399:0:17169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784045551.199406:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d98b expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045551.199414:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d98b expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045551.199423:0:17169:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784045551.199425:0:17169:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939b840c4000 from 9 10000000:01000000:2.0:1784045551.199431:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784045551.199478:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045551.199487:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045551.199495:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045551.199507:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873923712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784045551.199531:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045551.199544:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fd08b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045551.199556:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873923712 00000100:00100000:2.0:1784045551.199560:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873923712 00000100:00100000:2.0:1784045551.199581:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784045551.199587:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+20:17169:x1870706873923712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045551.199594:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045551.199603:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81986400/0x5475624df454d999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454d992 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045551.199618:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986400/0x5475624df454d999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454d992 expref: 21 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045551.199627:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81986400/0x5475624df454d999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d992 expref: 21 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045551.199634:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986400, rc 0) 00000100:00100000:2.0:1784045551.199659:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+21:17169:x1870706873923712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045551.199672:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784045551.199703:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873923712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045551.200164:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d999 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045551.200174:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454d999 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045551.200214:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873923840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784045551.200244:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045551.200280:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fd08b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784045551.200540:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873923840 00000100:00100000:0.0:1784045551.200546:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873923840 00000100:00100000:0.0:1784045551.200578:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784045551.200585:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+21:17169:x1870706873923840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784045551.200599:0:17164:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784045551.200613:0:17164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784045551.200615:0:17164:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1784045551.200712:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+21:17169:x1870706873923840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045551.200727:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784045551.202728:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873923840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784045551.202805:0:17169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784045551.202816:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d999 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045551.202827:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d999 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045551.640714:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784045552.216675:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784045552.661676:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045553.710334:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045554.323922:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873923968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045554.323990:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045554.324118:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873923968 00000100:00100000:1.0:1784045554.324125:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873923968 00000100:00100000:1.0:1784045554.324170:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784045554.324179:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873923968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045554.324212:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784045554.324256:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873923968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045554.324264:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784045554.324311:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873923968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045554.328315:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873924096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045554.328396:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045554.328798:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873924096 00000100:00100000:1.0:1784045554.328807:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873924096 00000100:00100000:1.0:1784045554.328860:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784045554.328869:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873924096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784045554.328901:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784045554.328954:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873924096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045554.328962:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784045554.329053:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873924096:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784045554.708255:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784045554.835635:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784045554.835641:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784045554.835643:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784045554.835646:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784045554.835662:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784045554.835665:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784045554.835667:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784045554.835670:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784045554.835795:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873924608:0@lo:400:kworker.0 00000100:00100000:2.0:1784045554.835867:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045554.835909:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784045554.835914:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873924224:0@lo:400:kworker.0 00000100:00100000:2.0:1784045554.835939:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045554.835961:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873924736:0@lo:400:kworker.0 00000100:00100000:2.0:1784045554.835980:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045554.836000:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873924352:0@lo:400:kworker.0 00000100:00100000:2.0:1784045554.836018:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045554.836045:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873924608 00000100:00100000:2.0:1784045554.836051:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873924608 00000100:00100000:2.0:1784045554.836095:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873924736 00000100:00100000:2.0:1784045554.836097:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873924736 00000100:00100000:2.0:1784045554.836107:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873924352 00000100:00100000:2.0:1784045554.836109:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873924352 00000100:00100000:2.0:1784045554.836122:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784045554.836130:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873924608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045554.836176:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873924608:12345-0@lo:400:kworker.0 Request processed in 46us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045554.836184:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784045554.836197:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784045554.836203:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873924736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045554.836225:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873924736:12345-0@lo:400:kworker.0 Request processed in 23us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045554.836231:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784045554.836240:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045554.836245:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873924352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045554.836279:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873924352:12345-0@lo:400:kworker.0 Request processed in 34us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045554.836284:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045554.836299:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873924224 00000100:00100000:2.0:1784045554.836302:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873924224 00000100:00100000:2.0:1784045554.836323:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784045554.836328:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:3625:x1870706873924224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045554.836350:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:3625:x1870706873924224:12345-0@lo:400:kworker.0 Request processed in 23us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045554.836356:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1784045554.836396:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045554.836400:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784045554.836438:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b836d1c00 x1870706873924352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045554.836473:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873924352:0@lo:400:kworker.0 00000100:00100000:2.0:1784045554.836495:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873924224:0@lo:400:kworker.0 00010000:00080000:2.0:1784045554.836503:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b836d3800 x1870706873924736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045554.836511:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873924736:0@lo:400:kworker.0 00010000:00080000:2.0:1784045554.836519:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b836d1f80 x1870706873924608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045554.836526:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873924608:0@lo:400:kworker.0 00000100:00100000:1.0:1784045554.836647:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873924480:0@lo:400:kworker.0 00000100:00100000:1.0:1784045554.836676:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045554.837080:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873924480 00000100:00100000:2.0:1784045554.837085:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873924480 00000100:00100000:2.0:1784045554.837126:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045554.837132:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873924480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045554.837172:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873924480:12345-0@lo:400:kworker.0 Request processed in 41us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045554.837179:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1784045554.837203:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b836d1180 x1870706873924480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045554.837212:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873924480:0@lo:400:kworker.0 00000040:00080000:2.0:1784045555.161050:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784045555.731814:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045556.772611:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784045557.524004:0:19048:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784045557.782762:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784045558.763341:0:19100:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045558.763765:0:19100:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784045558.805922:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045543/real 1784045543] req@ffff939cbf4ce680 x1870706873918208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045558 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045558.805952:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939cbf4ce680 x1870706873918208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045558 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045558.805962:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045543/real 1784045543] req@ffff939cbf4cfb80 x1870706873918336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045558 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045558.805973:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939cbf4cfb80 x1870706873918336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045558 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784045558.805994:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb59c6800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784045558.806022:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784045558.806026:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873918208:0@lo:8:kworker.0 00000100:00080000:0.0:1784045558.806032:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb59c2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784045558.806038:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784045558.806041:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873918336:0@lo:8:kworker.0 00000100:00080000:2.0:1784045558.806431:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045558.806435:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784045558.806438:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045558.806440:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784045558.806495:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045558.806498:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784045558.806501:0:38:0:(import.c:65:import_set_state_nolock()) ffff939cb59c6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784045558.806506:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 499 00000100:00080000:2.0:1784045558.806511:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784045558.806518:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff939cb59c6800 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045558.806538:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939cb684ad80 x1870706873925376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784045558.806550:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784045558.806564:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784045558.806565:0:38:0:(import.c:65:import_set_state_nolock()) ffff939cb59c2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784045558.806569:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 499 00000100:00080000:2.0:1784045558.806571:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784045558.806575:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939cb59c2000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045558.806588:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939cb6848a80 x1870706873925504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784045558.806631:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873924992:0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.806696:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045558.806744:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873925760:0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.806770:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045558.806791:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784045558.806796:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c25407c2-0928-423d-881e-1585e6e3cc3c:3624:1870706873924864:0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.806819:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045558.806839:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873925632:0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.806875:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045558.806900:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873925120:0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.806921:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045558.806935:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873925888:0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.806952:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045558.806969:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045558.806974:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873925248:0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.806993:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045558.807025:0:17913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873924992 00000100:00100000:2.0:1784045558.807032:0:17913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873924992 00000100:00100000:2.0:1784045558.807074:0:17913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873925248 00000100:00100000:2.0:1784045558.807077:0:17913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873925248 00000100:00100000:2.0:1784045558.807094:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784045558.807101:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873924992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.807152:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873924992:12345-0@lo:400:kworker.0 Request processed in 50us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045558.807159:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784045558.807173:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045558.807179:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873925248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.807206:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873925248:12345-0@lo:400:kworker.0 Request processed in 27us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045558.807211:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045558.807228:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873925760 00000100:00100000:2.0:1784045558.807231:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873925760 00000100:00100000:2.0:1784045558.807255:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873925632 00000100:00100000:2.0:1784045558.807258:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873925632 00000100:00100000:2.0:1784045558.807267:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873925120 00000100:00100000:2.0:1784045558.807269:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873925120 00000100:00100000:2.0:1784045558.807277:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873925888 00000100:00100000:2.0:1784045558.807279:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873925888 00000100:00100000:2.0:1784045558.807293:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045558.807298:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873925760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.807325:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873925760:12345-0@lo:400:kworker.0 Request processed in 27us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045558.807331:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045558.807342:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784045558.807347:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873925632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.807369:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873925632:12345-0@lo:400:kworker.0 Request processed in 22us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045558.807380:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784045558.807402:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784045558.807408:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873925120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.807435:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873925120:12345-0@lo:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045558.807441:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784045558.807476:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784045558.807482:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873925888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.807508:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873925888:12345-0@lo:400:kworker.0 Request processed in 26us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045558.807513:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784045558.807530:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873924864 00000100:00100000:2.0:1784045558.807533:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873924864 00000100:00100000:2.0:1784045558.807557:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784045558.807563:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+21:3624:x1870706873924864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.807592:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+21:3624:x1870706873924864:12345-0@lo:400:kworker.0 Request processed in 29us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045558.807598:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1784045558.807638:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045558.807643:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045558.807671:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873925248:0@lo:400:kworker.0 00010000:00080000:2.0:1784045558.807682:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cb6849180 x1870706873925120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045558.807691:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873925120:0@lo:400:kworker.0 00010000:00080000:2.0:1784045558.807712:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cb6849f80 x1870706873925888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045558.807720:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873925888:0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.807745:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c25407c2-0928-423d-881e-1585e6e3cc3c:3624:1870706873924864:0@lo:400:kworker.0 00010000:00080000:2.0:1784045558.807756:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cb6848380 x1870706873925632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045558.807763:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873925632:0@lo:400:kworker.0 00000100:00100000:2.0:1784045558.807772:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873924992:0@lo:400:kworker.0 00010000:00080000:2.0:1784045558.807779:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cb684aa00 x1870706873925760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045558.807787:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873925760:0@lo:400:kworker.0 00010000:00010000:3.0:1784045558.808051:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045558.808165:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873925376:0@lo:8:kworker.0 00000100:00100000:0.0:1784045558.808207:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045558.808241:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873925504:0@lo:8:kworker.0 00000100:00100000:0.0:1784045558.808265:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045558.808337:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873925376 00000100:00100000:3.0:1784045558.808342:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873925376 00000100:00100000:3.0:1784045558.808369:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873925504 00000100:00100000:3.0:1784045558.808372:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873925504 00000100:00100000:3.0:1784045558.808383:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045558.808398:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1870706873925376:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1784045558.808424:0:18682:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1784045558.808484:0:18682:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454d9a0 00002000:00100000:3.0:1784045558.808498:0:18682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff939b841fe800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1784045558.808502:0:18682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1784045558.808505:0:18682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784045558.808681:0:18682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1784045558.808704:0:18682:0:(import.c:65:import_set_state_nolock()) ffff939b841ff000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045558.808765:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1870706873925376:12345-0@lo:8:kworker.0 Request processed in 374us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045558.808772:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784045558.808788:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045558.808792:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1870706873925504:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784045558.808804:0:18682:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1784045558.810254:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cb684ad80 x1870706873925376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784045578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045558.810267:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784045558.810276:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1784045558.810285:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784045558.810290:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784045558.810293:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb59c6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784045558.810315:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784045558.810322:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873925376:0@lo:8:kworker.0 00000004:00080000:2.0:1784045558.810351:0:17914:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784045558.810486:0:17914:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 514919040859ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784045558.810494:0:17914:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1784045558.810840:0:17915:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1784045558.810879:0:17915:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17915:1870706873926144:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1784045558.810945:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045558.810975:0:17915:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8831e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045558.811000:0:18683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1784045558.811007:0:18683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1784045558.811736:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873926016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045558.811774:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045558.812126:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873926144 00000100:00100000:0.0:1784045558.812134:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873926144 00000100:00080000:0.0:1784045558.812191:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045558.812613:0:19104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045558.812624:0:19104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17915:x1870706873926144:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:2.0:1784045558.817779:0:19104:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1784045558.817790:0:19104:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1784045558.819536:0:19104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17915:x1870706873926144:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6903us (8580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045558.819552:0:19104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784045558.821070:0:17915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82a8e680 x1870706873926144/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784045574 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045558.821090:0:17915:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17915:1870706873926144:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1784045558.821105:0:17915:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1784045558.821166:0:17915:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17915:1870706873926272:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1784045558.821222:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045558.821253:0:17915:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045558.821524:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873926016 00000100:00100000:1.0:1784045558.821532:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873926016 00000100:00100000:1.0:1784045558.821583:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784045558.821591:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1870706873926016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045558.821620:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784045558.821685:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1870706873926016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (9910us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045558.821693:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784045558.821740:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939c91563100 x1870706873926016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045558.821757:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873926016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045558.823675:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873926272 00000100:00100000:2.0:1784045558.823688:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873926272 00000100:00100000:2.0:1784045558.823741:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784045558.823753:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17915:x1870706873926272:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1784045558.823784:0:18683:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1784045558.823872:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17915:x1870706873926272:12345-0@lo:5:osp-pre-0-1.0 Request processed in 121us (2649us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045558.823880:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784045558.824015:0:17915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b836d3100 x1870706873926272/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045574 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045558.824030:0:17915:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17915:1870706873926272:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1784045558.824045:0:17915:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1784045558.824088:0:17915:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17915:1870706873926400:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1784045558.825706:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045558.825752:0:17915:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d16c0 going to sleep for 11 seconds 00000004:00080000:2.0:1784045558.827192:0:17905:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1784045558.827506:0:19104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873926400 00000100:00100000:0.0:1784045558.827515:0:19104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873926400 00000100:00100000:0.0:1784045558.827567:0:19104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045558.827577:0:19104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17915:x1870706873926400:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1784045558.827624:0:19104:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1784045558.843346:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1870706873925504:12345-0@lo:8:kworker.0 Request processed in 34545us (35072us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784045558.843360:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1784045558.843892:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb59c2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784045558.843899:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784045558.843903:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873925504:0@lo:8:kworker.0 00000001:00080000:2.0:1784045558.860285:0:18677:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1784045558.860306:0:18677:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1784045558.860758:0:19104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17915:x1870706873926400:12345-0@lo:5:osp-pre-0-1.0 Request processed in 33175us (35049us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1784045558.860775:0:19104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1784045558.860906:0:17915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b836d3100 x1870706873926400/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045574 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045558.860918:0:17915:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1784045558.860925:0:17915:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17915:1870706873926400:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1784045558.860940:0:17915:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1784045558.860989:0:17915:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17915:1870706873926528:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1784045558.861027:0:17915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045558.861062:0:17915:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045558.861085:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873926528 00000100:00100000:1.0:1784045558.861091:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873926528 00000100:00100000:1.0:1784045558.861129:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045558.861138:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17915:x1870706873926528:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1784045558.861181:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17915:x1870706873926528:12345-0@lo:900:osp-pre-0-1.0 Request processed in 45us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045558.861189:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784045558.861225:0:17915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b836d3100 x1870706873926528/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784045574 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045558.861234:0:17915:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17915:1870706873926528:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1784045559.443862:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045559.443891:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873926656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784045559.443977:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045559.444099:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873926784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045559.444127:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045559.444169:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873926656 00000100:00100000:3.0:1784045559.444176:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873926656 00000100:00100000:3.0:1784045559.444223:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873926784 00000100:00100000:3.0:1784045559.444226:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873926784 00000100:00100000:3.0:1784045559.444245:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784045559.444254:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873926656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045559.444286:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784045559.444333:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873926656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045559.444355:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784045559.444396:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784045559.444403:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873926784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784045559.444437:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784045559.445145:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873926784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 739us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045559.445153:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784045559.445203:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873926784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784045559.445219:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873926656:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784045559.832064:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784045559.837221:0:19151:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784045559.838008:0:19151:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784045560.852891:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045561.878838:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784045562.455517:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784045562.901981:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045563.924647:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784045564.052535:0:18435:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045564.052540:0:18435:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784045564.052542:0:18435:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045564.052545:0:18435:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784045564.052577:0:18435:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045564.052580:0:18435:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784045564.052583:0:18435:0:(import.c:65:import_set_state_nolock()) ffff939cb59c2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045564.052592:0:18435:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 514 00000100:00080000:3.0:1784045564.052598:0:18435:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784045564.052605:0:18435:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939cb59c2000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:2.0:1784045564.053142:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873926912:0@lo:400:kworker.0 00000100:00100000:2.0:1784045564.053215:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045564.053264:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873927424:0@lo:400:kworker.0 00000100:00100000:2.0:1784045564.053306:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045564.053334:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045564.053340:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873927040:0@lo:400:kworker.0 00000100:00100000:2.0:1784045564.053377:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045564.053413:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873926912 00000100:00100000:2.0:1784045564.053420:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873926912 00000100:00100000:2.0:1784045564.053486:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784045564.053495:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+21:3625:x1870706873926912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045564.053541:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+21:3625:x1870706873926912:12345-0@lo:400:kworker.0 Request processed in 48us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045564.053548:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784045564.053580:0:17913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873927040 00000100:00100000:2.0:1784045564.053584:0:17913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873927040 00000100:00100000:2.0:1784045564.053611:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784045564.053617:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873927040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045564.054997:0:18435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82881f80 x1870706873927680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784045564.055347:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873927168:0@lo:400:kworker.0 00000100:00100000:3.0:1784045564.055424:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045564.055483:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873927808:0@lo:400:kworker.0 00000100:00100000:3.0:1784045564.055505:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045564.055529:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784045564.055536:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873927296:0@lo:400:kworker.0 00000100:00100000:3.0:1784045564.055561:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045564.055578:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873927936:0@lo:400:kworker.0 00000100:00100000:3.0:1784045564.055602:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045564.055652:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873927296 00000100:00100000:3.0:1784045564.055658:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873927296 00000100:00100000:3.0:1784045564.055695:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784045564.055702:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873927296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045564.055753:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873927296:12345-0@lo:400:kworker.0 Request processed in 51us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045564.055760:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784045564.055784:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873927168 00000100:00100000:3.0:1784045564.055788:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873927168 00000100:00100000:3.0:1784045564.055812:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873927808 00000100:00100000:3.0:1784045564.055815:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873927808 00000100:00100000:3.0:1784045564.055826:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873927936 00000100:00100000:3.0:1784045564.055828:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873927936 00000100:00100000:0.0:1784045564.055845:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873927552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045564.055890:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045564.055923:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784045564.055929:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873928064:0@lo:400:kworker.0 00000100:00100000:0.0:1784045564.055952:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045564.055981:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873927424 00000100:00100000:0.0:1784045564.055985:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873927424 00000100:00100000:2.0:1784045564.059671:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873927040:12345-0@lo:400:kworker.0 Request processed in 6043us (6282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045564.059687:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784045564.059794:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873927040:0@lo:400:kworker.0 00000100:00100000:2.0:1784045564.059808:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873926912:0@lo:400:kworker.0 00000100:00100000:1.0:1784045564.060120:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873927680:0@lo:8:kworker.0 00000100:00100000:1.0:1784045564.060162:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045564.060214:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873927552 00000100:00100000:1.0:1784045564.060220:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873927552 00000100:00100000:1.0:1784045564.060264:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045564.060273:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1870706873927552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045564.060391:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784045564.060463:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1870706873927552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 171us (4552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045564.060470:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784045564.060496:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873927680 00000100:00100000:1.0:1784045564.060511:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873927680 00000100:00100000:1.0:1784045564.060528:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045564.060531:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1870706873927680:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1784045564.060546:0:18683:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784045564.063017:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873928064 00000100:00100000:2.0:1784045564.063029:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873928064 00000100:00100000:3.0:1784045564.063566:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873927296:0@lo:400:kworker.0 00000100:00100000:3.0:1784045564.063601:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784045564.063611:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873927168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045564.063708:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873927168:12345-0@lo:400:kworker.0 Request processed in 99us (8285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045564.063715:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784045564.063754:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784045564.063760:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873927808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045564.063786:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1870706873927808:12345-0@lo:400:kworker.0 Request processed in 27us (8281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045564.063792:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1784045564.063984:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82882300 x1870706873927168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045564.063996:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873927168:0@lo:400:kworker.0 00010000:00080000:3.0:1784045564.064008:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b83383480 x1870706873927808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045564.064015:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1870706873927808:0@lo:400:kworker.0 00000100:00100000:3.0:1784045564.064061:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784045564.064067:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873927936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045564.064102:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873927936:12345-0@lo:400:kworker.0 Request processed in 35us (8499us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045564.064107:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1784045564.064132:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b83383800 x1870706873927936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045564.064140:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873927936:0@lo:400:kworker.0 00010000:00080000:0.0:1784045564.066571:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b836d3100 x1870706873927552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045564.066597:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873927552:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784045564.066634:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784045564.066641:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045564.066644:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045564.066713:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784045564.066724:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873927424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045564.066809:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873927424:12345-0@lo:400:kworker.0 Request processed in 89us (13502us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045564.066831:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784045564.066863:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82881180 x1870706873927424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045564.066890:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873927424:0@lo:400:kworker.0 00000100:00100000:2.0:1784045564.067625:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784045564.067646:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873928064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045564.067708:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1870706873928064:12345-0@lo:400:kworker.0 Request processed in 75us (11754us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045564.067726:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784045564.068142:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1870706873927680:12345-0@lo:8:kworker.0 Request processed in 7606us (7976us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784045564.068150:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1784045564.068191:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb59c2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784045564.068196:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784045564.068205:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873927680:0@lo:8:kworker.0 00010000:00080000:0.0:1784045564.070619:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b83381c00 x1870706873928064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045564.070635:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1870706873928064:0@lo:400:kworker.0 00000100:00100000:0.0:1784045564.563903:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873928192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045564.563973:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045564.564035:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784045564.564044:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873928320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045564.564071:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045564.564102:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873928192 00000100:00100000:0.0:1784045564.564109:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873928192 00000100:00100000:0.0:1784045564.564159:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873928320 00000100:00100000:0.0:1784045564.564162:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873928320 00000100:00100000:0.0:1784045564.564177:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784045564.564184:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873928192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045564.564230:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784045564.564275:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873928192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045564.564282:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784045564.564298:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784045564.564305:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873928320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784045564.564336:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784045564.564381:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873928320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045564.564388:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784045564.564439:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873928320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045564.564504:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83383800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873928192:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1784045564.949622:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045565.086550:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045545/real 1784045545] req@ffff939cbf4cc000 x1870706873919104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045565 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045565.086578:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939cbf4cc000 x1870706873919104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045565 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045565.086602:0:3622:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784045545/real 1784045545] req@ffff939cbf4cca80 x1870706873919232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045565 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045565.086615:0:3622:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff939cbf4cca80 x1870706873919232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784045565 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784045565.086635:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c937be000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045565.086655:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784045565.086659:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873919104:0@lo:8:kworker.0 00000100:00080000:3.0:1784045565.086664:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb5a99000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045565.086669:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784045565.086672:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873919232:0@lo:8:kworker.0 00000100:00080000:3.0:1784045565.086880:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045565.086884:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784045565.086887:0:37:0:(import.c:65:import_set_state_nolock()) ffff939c937be000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045565.086891:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1784045565.086896:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784045565.086903:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff939c937be000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045565.086920:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b83382d80 x1870706873928704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045565.086931:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045565.086934:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784045565.086935:0:37:0:(import.c:65:import_set_state_nolock()) ffff939cb5a99000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045565.086938:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1784045565.086940:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784045565.086950:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939cb5a99000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045565.086963:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b83383b80 x1870706873928832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045565.087000:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045565.087003:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784045565.087005:0:37:0:(import.c:65:import_set_state_nolock()) ffff939cb59c2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045565.087008:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 520 00000100:00080000:3.0:1784045565.087011:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784045565.087015:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939cb59c2000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045565.087025:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b83380a80 x1870706873929344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784045565.087063:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873929088:0@lo:400:kworker.0 00000100:00100000:3.0:1784045565.087122:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045565.087148:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873929728:0@lo:400:kworker.0 00000100:00100000:3.0:1784045565.087171:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045565.087191:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1784045565.087197:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873928448:0@lo:400:kworker.0 00000100:00100000:3.0:1784045565.087223:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045565.087247:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873929216:0@lo:400:kworker.0 00000100:00100000:3.0:1784045565.087269:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045565.087296:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873928704:0@lo:8:kworker.0 00000100:00100000:3.0:1784045565.087316:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045565.087333:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873928832:0@lo:8:kworker.0 00000100:00100000:3.0:1784045565.087368:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045565.087395:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873929344:0@lo:8:kworker.0 00000100:00100000:3.0:1784045565.087415:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045565.087469:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873929728 00000100:00100000:3.0:1784045565.087476:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873929728 00000100:00100000:3.0:1784045565.087518:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784045565.087526:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873929728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045565.087574:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873929728:12345-0@lo:400:kworker.0 Request processed in 48us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045565.087581:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784045565.087601:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873929216 00000100:00100000:3.0:1784045565.087604:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873929216 00000100:00100000:3.0:1784045565.087619:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873928704 00000100:00100000:3.0:1784045565.087621:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873928704 00000100:00100000:3.0:1784045565.087629:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873928832 00000100:00100000:3.0:1784045565.087631:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873928832 00000100:00100000:3.0:1784045565.087636:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873929344 00000100:00100000:3.0:1784045565.087638:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873929344 00000100:00100000:3.0:1784045565.087646:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045565.087651:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873929216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045565.087679:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873929216:12345-0@lo:400:kworker.0 Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045565.087685:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784045565.087697:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045565.087701:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1870706873928704:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1784045565.087724:0:18682:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:3.0:1784045565.087752:0:18682:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454d9a7 00002000:00100000:3.0:1784045565.087764:0:18682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff939b841f9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784045565.087777:0:18682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1784045565.087780:0:18682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784045565.087851:0:18682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784045565.087873:0:18682:0:(import.c:65:import_set_state_nolock()) ffff939b841fb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045565.087910:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1870706873928704:12345-0@lo:8:kworker.0 Request processed in 206us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045565.087916:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784045565.087929:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784045565.087933:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1870706873928832:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784045565.087942:0:18682:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784045565.087966:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1870706873928832:12345-0@lo:8:kworker.0 Request processed in 31us (597us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784045565.087971:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784045565.087981:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045565.087985:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1870706873929344:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1784045565.087992:0:18682:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784045565.088014:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1870706873929344:12345-0@lo:8:kworker.0 Request processed in 28us (598us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784045565.088019:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1784045565.088057:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b83381180 x1870706873929216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784045581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045565.088067:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873929216:0@lo:400:kworker.0 00010000:00080000:3.0:1784045565.088077:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b83383100 x1870706873929728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045565.088083:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83383100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873929728:0@lo:400:kworker.0 00010000:00080000:3.0:1784045565.088116:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b83382d80 x1870706873928704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784045590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045565.088123:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784045565.088130:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1784045565.088137:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784045565.088141:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784045565.088144:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939c937be000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784045565.088155:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784045565.088160:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873928704:0@lo:8:kworker.0 00000100:00080000:3.0:1784045565.088170:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb5a99000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045565.088173:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784045565.088176:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873928832:0@lo:8:kworker.0 00000100:00080000:3.0:1784045565.088182:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb59c2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045565.088185:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784045565.088187:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83380a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873929344:0@lo:8:kworker.0 00000004:00080000:3.0:1784045565.088208:0:17196:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784045565.088273:0:17196:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 521196828533ns, next at 0ns, rc = 0 00080000:00080000:3.0:1784045565.088281:0:17196:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784045565.088637:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873928448 00000100:00100000:2.0:1784045565.088643:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873928448 00000100:00100000:2.0:1784045565.088681:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784045565.088688:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:3623:x1870706873928448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045565.088738:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:3623:x1870706873928448:12345-0@lo:400:kworker.0 Request processed in 50us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045565.088744:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000004:00080000:2.0:1784045565.088796:0:17197:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1784045565.088811:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17197:1870706873929984:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784045565.088843:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045565.088862:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c937eaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1784045565.088882:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83383480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873928448:0@lo:400:kworker.0 00000100:00100000:2.0:1784045565.088895:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045565.088905:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873929856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045565.088930:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045565.088954:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873929984 00000100:00100000:2.0:1784045565.088958:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873929984 00000100:00100000:2.0:1784045565.088988:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045565.088994:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17197:x1870706873929984:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784045565.089197:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873929856 00000100:00100000:2.0:1784045565.089201:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873929856 00000100:00100000:2.0:1784045565.089229:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784045565.089235:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1870706873929856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784045565.089248:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1784045565.089303:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1870706873929856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045565.089310:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1784045565.089328:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784045565.089362:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939cbf4cca80 x1870706873929856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045565.089376:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873929856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784045565.090692:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873928576:0@lo:400:kworker.0 00000100:00100000:0.0:1784045565.090748:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045565.090785:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873929472:0@lo:400:kworker.0 00000100:00100000:0.0:1784045565.090808:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045565.090846:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784045565.090852:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873928960:0@lo:400:kworker.0 00000100:00100000:0.0:1784045565.090872:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045565.090888:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873929600:0@lo:400:kworker.0 00000100:00100000:0.0:1784045565.090904:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045565.090934:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873929088 00000100:00100000:0.0:1784045565.090940:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873929088 00000100:00100000:0.0:1784045565.090976:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873928576 00000100:00100000:0.0:1784045565.090979:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873928576 00000100:00100000:0.0:1784045565.090995:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784045565.091002:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873929088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045565.091056:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873929088:12345-0@lo:400:kworker.0 Request processed in 53us (3932us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045565.091062:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784045565.091077:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784045565.091094:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873928576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045565.091129:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873928576:12345-0@lo:400:kworker.0 Request processed in 35us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045565.091135:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784045565.091153:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873929472 00000100:00100000:0.0:1784045565.091157:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873929472 00000100:00100000:0.0:1784045565.091178:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873928960 00000100:00100000:0.0:1784045565.091181:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873928960 00000100:00100000:0.0:1784045565.091190:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873929600 00000100:00100000:0.0:1784045565.091192:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873929600 00000100:00100000:0.0:1784045565.091204:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784045565.091209:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873929472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045565.091237:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873929472:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045565.091243:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784045565.091255:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784045565.091343:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873928960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045565.091387:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873928960:12345-0@lo:400:kworker.0 Request processed in 46us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045565.091392:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784045565.091403:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784045565.091409:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873929600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045565.091430:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873929600:12345-0@lo:400:kworker.0 Request processed in 22us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045565.091435:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784045565.091509:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873929088:0@lo:400:kworker.0 00010000:00080000:0.0:1784045565.091888:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b83382680 x1870706873928960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045565.091898:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873928960:0@lo:400:kworker.0 00010000:00080000:0.0:1784045565.091908:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b83380e00 x1870706873929600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045565.091915:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83380e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873929600:0@lo:400:kworker.0 00000100:00100000:0.0:1784045565.091924:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873928576:0@lo:400:kworker.0 00010000:00080000:0.0:1784045565.091931:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b83381f80 x1870706873929472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045565.091937:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873929472:0@lo:400:kworker.0 00002000:00080000:3.0:1784045565.095993:0:18682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1784045565.096005:0:18682:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1784045565.096012:0:18682:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:0.0:1784045565.114124:0:17152:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1784045565.116613:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.116627:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000778b8323/0x5475624df454d9ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.116644:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.116655:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.116662:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000778b8323/0x5475624df454d9ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.116740:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000778b8323/0x5475624df454d9ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.116750:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000778b8323/0x5475624df454d9ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.116757:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000778b8323/0x5475624df454d9ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.116778:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784045565.118123:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.118136:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edbbb73a/0x5475624df454d9b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.118152:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.118156:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.118162:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edbbb73a/0x5475624df454d9b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.118176:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edbbb73a/0x5475624df454d9b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.118186:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edbbb73a/0x5475624df454d9b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.118202:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edbbb73a/0x5475624df454d9b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.118225:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784045565.118835:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.118844:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008882b811/0x5475624df454d9bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.118855:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.118858:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.118863:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008882b811/0x5475624df454d9bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.118874:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008882b811/0x5475624df454d9bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.118883:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008882b811/0x5475624df454d9bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.118890:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008882b811/0x5475624df454d9bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119025:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784045565.119325:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.119331:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e626227f/0x5475624df454d9c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119344:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.119348:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.119364:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e626227f/0x5475624df454d9c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119375:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e626227f/0x5475624df454d9c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119383:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e626227f/0x5475624df454d9c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119391:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e626227f/0x5475624df454d9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119400:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1784045565.119586:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784045565.119593:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000778b8323/0x5475624df454d9ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119602:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93633600 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.119606:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000778b8323/0x5475624df454d9ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119615:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000778b8323/0x5475624df454d9ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119644:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000778b8323/0x5475624df454d9ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119652:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000778b8323/0x5475624df454d9ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119826:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784045565.119831:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edbbb73a/0x5475624df454d9b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119839:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93633800 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.119842:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edbbb73a/0x5475624df454d9b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119850:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edbbb73a/0x5475624df454d9b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119862:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edbbb73a/0x5475624df454d9b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119869:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edbbb73a/0x5475624df454d9b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119881:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045565.119884:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008882b811/0x5475624df454d9bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119968:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93633a00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.119972:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008882b811/0x5475624df454d9bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119980:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008882b811/0x5475624df454d9bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119991:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008882b811/0x5475624df454d9bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.119999:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008882b811/0x5475624df454d9bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120012:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.120016:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e626227f/0x5475624df454d9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120022:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93632000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.120025:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e626227f/0x5475624df454d9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120031:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e626227f/0x5475624df454d9c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120040:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e626227f/0x5475624df454d9c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120055:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e626227f/0x5475624df454d9c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120068:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.120070:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.120072:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.120080:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.120126:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.120132:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de4bbf60/0x5475624df454d9ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120142:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.120146:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.120152:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de4bbf60/0x5475624df454d9ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120162:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de4bbf60/0x5475624df454d9ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120172:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de4bbf60/0x5475624df454d9ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120180:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de4bbf60/0x5475624df454d9ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120195:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045565.120386:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.120391:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de4bbf60/0x5475624df454d9ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120398:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93633000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.120401:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de4bbf60/0x5475624df454d9ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120409:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de4bbf60/0x5475624df454d9ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120420:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de4bbf60/0x5475624df454d9ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120426:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de4bbf60/0x5475624df454d9ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.120439:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.120441:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.120594:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.121006:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.121013:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058fba8b6/0x5475624df454d9d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.121036:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.121040:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.121044:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058fba8b6/0x5475624df454d9d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.121066:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058fba8b6/0x5475624df454d9d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.121075:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058fba8b6/0x5475624df454d9d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.121081:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058fba8b6/0x5475624df454d9d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.121097:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045565.121218:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.121225:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058fba8b6/0x5475624df454d9d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.121233:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93633e00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.121236:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058fba8b6/0x5475624df454d9d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.121245:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058fba8b6/0x5475624df454d9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.121257:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058fba8b6/0x5475624df454d9d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.121265:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058fba8b6/0x5475624df454d9d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.121288:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.121290:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.121292:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.122125:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.122134:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e900286e/0x5475624df454d9d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.122146:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.122150:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.122155:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e900286e/0x5475624df454d9d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.122167:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e900286e/0x5475624df454d9d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.122175:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e900286e/0x5475624df454d9d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.122182:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e900286e/0x5475624df454d9d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.122197:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045565.124121:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.124140:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e900286e/0x5475624df454d9d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.124175:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93633c00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.124179:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e900286e/0x5475624df454d9d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.124190:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e900286e/0x5475624df454d9d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.124211:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e900286e/0x5475624df454d9d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.124218:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e900286e/0x5475624df454d9d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.124245:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.124247:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.124249:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.126546:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.126559:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072f20680/0x5475624df454d9df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.126575:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.126580:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.126587:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072f20680/0x5475624df454d9df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.126600:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072f20680/0x5475624df454d9df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.126628:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072f20680/0x5475624df454d9df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.126636:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072f20680/0x5475624df454d9df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.126654:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045565.127307:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.127315:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072f20680/0x5475624df454d9df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.127326:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93632c00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.127330:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072f20680/0x5475624df454d9df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.127339:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072f20680/0x5475624df454d9df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.127367:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072f20680/0x5475624df454d9df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.127374:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072f20680/0x5475624df454d9df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.127394:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.127401:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.127403:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.127480:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.127488:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000811af221/0x5475624df454d9e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.127498:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.127502:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.127506:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000811af221/0x5475624df454d9e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.127517:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000811af221/0x5475624df454d9e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.127524:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000811af221/0x5475624df454d9e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.127530:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000811af221/0x5475624df454d9e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.127545:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784045565.128110:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.128117:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005faae317/0x5475624df454d9ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128126:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.128130:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.128134:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005faae317/0x5475624df454d9ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128150:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005faae317/0x5475624df454d9ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128158:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005faae317/0x5475624df454d9ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128165:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005faae317/0x5475624df454d9ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128182:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784045565.128284:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045565.128290:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000811af221/0x5475624df454d9e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128298:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106e400 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.128302:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000811af221/0x5475624df454d9e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128310:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000811af221/0x5475624df454d9e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128322:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000811af221/0x5475624df454d9e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128329:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000811af221/0x5475624df454d9e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128361:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.128365:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005faae317/0x5475624df454d9ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128372:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106ee00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.128375:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005faae317/0x5475624df454d9ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128382:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005faae317/0x5475624df454d9ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128393:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005faae317/0x5475624df454d9ed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128400:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005faae317/0x5475624df454d9ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.128411:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.128413:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.128414:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.128422:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.129182:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.129191:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b9ee852/0x5475624df454d9f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129201:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.129211:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.129217:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b9ee852/0x5475624df454d9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129228:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b9ee852/0x5475624df454d9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129238:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b9ee852/0x5475624df454d9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129245:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b9ee852/0x5475624df454d9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129262:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045565.129497:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.129503:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b9ee852/0x5475624df454d9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129511:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106f800 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.129515:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9ee852/0x5475624df454d9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129522:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b9ee852/0x5475624df454d9f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129536:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b9ee852/0x5475624df454d9f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129554:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b9ee852/0x5475624df454d9f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129571:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.129573:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.129575:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.129736:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.129742:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454d9fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129753:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.129756:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.129761:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454d9fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129771:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454d9fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129778:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454d9fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129786:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454d9fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.129801:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784045565.130190:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.130202:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002f1db7b/0x5475624df454da02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.130210:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.130213:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.130217:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002f1db7b/0x5475624df454da02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.130226:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002f1db7b/0x5475624df454da02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.130234:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002f1db7b/0x5475624df454da02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.130241:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002f1db7b/0x5475624df454da02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.130258:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784045565.130527:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.130533:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e64fd77/0x5475624df454da09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.130541:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.130544:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.130548:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e64fd77/0x5475624df454da09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.130557:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e64fd77/0x5475624df454da09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.130572:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e64fd77/0x5475624df454da09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.130578:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e64fd77/0x5475624df454da09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.130586:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784045565.130994:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.131001:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8e818a2/0x5475624df454da10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131009:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.131012:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.131016:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8e818a2/0x5475624df454da10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131027:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8e818a2/0x5475624df454da10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131035:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8e818a2/0x5475624df454da10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131042:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8e818a2/0x5475624df454da10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131065:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1784045565.131173:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784045565.131179:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454d9fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131189:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106fc00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.131193:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454d9fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131201:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454d9fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131217:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454d9fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131225:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454d9fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131245:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784045565.131249:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002f1db7b/0x5475624df454da02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131256:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106e200 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.131259:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002f1db7b/0x5475624df454da02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131277:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002f1db7b/0x5475624df454da02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131288:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002f1db7b/0x5475624df454da02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131295:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002f1db7b/0x5475624df454da02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131308:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045565.131312:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e64fd77/0x5475624df454da09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131318:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106f000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.131320:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e64fd77/0x5475624df454da09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131327:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e64fd77/0x5475624df454da09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131335:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e64fd77/0x5475624df454da09 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131341:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e64fd77/0x5475624df454da09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131373:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.131376:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8e818a2/0x5475624df454da10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131382:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106f600 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.131385:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8e818a2/0x5475624df454da10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131392:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8e818a2/0x5475624df454da10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131401:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8e818a2/0x5475624df454da10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131407:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8e818a2/0x5475624df454da10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131419:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.131421:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.131423:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.131430:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.131731:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.131738:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9e6176d/0x5475624df454da17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131748:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.131758:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.131763:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e6176d/0x5475624df454da17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131773:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9e6176d/0x5475624df454da17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131782:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9e6176d/0x5475624df454da17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131791:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9e6176d/0x5475624df454da17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.131814:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784045565.132238:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.132245:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000615f7179/0x5475624df454da1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.132255:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.132259:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.132264:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000615f7179/0x5475624df454da1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.132275:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000615f7179/0x5475624df454da1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.132535:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000615f7179/0x5475624df454da1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.132551:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000615f7179/0x5475624df454da1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.132566:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784045565.133013:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.133021:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f655e591/0x5475624df454da25 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133030:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.133033:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.133037:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f655e591/0x5475624df454da25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133048:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f655e591/0x5475624df454da25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133056:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f655e591/0x5475624df454da25 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133064:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f655e591/0x5475624df454da25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133073:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784045565.133171:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784045565.133178:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9e6176d/0x5475624df454da17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133192:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106fe00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.133197:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9e6176d/0x5475624df454da17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133205:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9e6176d/0x5475624df454da17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133221:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9e6176d/0x5475624df454da17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133230:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9e6176d/0x5475624df454da17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133249:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045565.133252:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000615f7179/0x5475624df454da1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133258:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106fa00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.133261:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000615f7179/0x5475624df454da1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133268:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000615f7179/0x5475624df454da1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133278:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000615f7179/0x5475624df454da1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133292:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000615f7179/0x5475624df454da1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133308:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.133312:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f655e591/0x5475624df454da25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133318:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106f400 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.133322:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f655e591/0x5475624df454da25 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133329:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f655e591/0x5475624df454da25 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133340:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f655e591/0x5475624df454da25 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133346:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f655e591/0x5475624df454da25 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133374:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.133377:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.133379:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.133712:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.133719:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000090fcaf1/0x5475624df454da2c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133737:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.133741:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.133746:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000090fcaf1/0x5475624df454da2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133757:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000090fcaf1/0x5475624df454da2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133765:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000090fcaf1/0x5475624df454da2c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133773:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000090fcaf1/0x5475624df454da2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.133789:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784045565.134396:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.134404:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b026c0fa/0x5475624df454da33 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134415:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.134418:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.134423:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b026c0fa/0x5475624df454da33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134433:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b026c0fa/0x5475624df454da33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134481:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b026c0fa/0x5475624df454da33 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134488:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b026c0fa/0x5475624df454da33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134497:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784045565.134645:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045565.134653:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000090fcaf1/0x5475624df454da2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134662:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106e000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.134665:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000090fcaf1/0x5475624df454da2c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134675:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000090fcaf1/0x5475624df454da2c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134689:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000090fcaf1/0x5475624df454da2c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134697:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000090fcaf1/0x5475624df454da2c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134714:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.134725:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b026c0fa/0x5475624df454da33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134733:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106ec00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.134736:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b026c0fa/0x5475624df454da33 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134745:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b026c0fa/0x5475624df454da33 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134756:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b026c0fa/0x5475624df454da33 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134763:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b026c0fa/0x5475624df454da33 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.134776:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.134778:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.134781:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.135170:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.135176:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a421558/0x5475624df454da3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135186:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.135189:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.135194:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a421558/0x5475624df454da3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135217:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a421558/0x5475624df454da3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135225:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a421558/0x5475624df454da3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135232:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a421558/0x5475624df454da3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135249:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045565.135257:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.135261:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a421558/0x5475624df454da3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135268:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106e800 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.135272:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a421558/0x5475624df454da3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135279:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a421558/0x5475624df454da3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135289:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a421558/0x5475624df454da3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135295:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a421558/0x5475624df454da3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135318:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.135320:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.135322:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.135727:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.135734:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc2cb7f2/0x5475624df454da41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135743:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.135746:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.135750:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2cb7f2/0x5475624df454da41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135760:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc2cb7f2/0x5475624df454da41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135766:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc2cb7f2/0x5475624df454da41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135773:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2cb7f2/0x5475624df454da41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135788:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045565.135795:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.135799:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc2cb7f2/0x5475624df454da41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135816:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106f200 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.135820:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2cb7f2/0x5475624df454da41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135827:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2cb7f2/0x5475624df454da41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135838:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc2cb7f2/0x5475624df454da41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.135846:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc2cb7f2/0x5475624df454da41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.136067:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.136069:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.136071:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.136405:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.136412:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f460caf/0x5475624df454da48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.136422:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.136425:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.136429:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f460caf/0x5475624df454da48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.136438:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f460caf/0x5475624df454da48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.136489:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f460caf/0x5475624df454da48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.136497:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f460caf/0x5475624df454da48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.136511:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045565.136519:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.136523:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f460caf/0x5475624df454da48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.136530:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106e600 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.136533:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f460caf/0x5475624df454da48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.136542:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f460caf/0x5475624df454da48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.136554:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f460caf/0x5475624df454da48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.136562:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f460caf/0x5475624df454da48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.136577:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.136586:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.136588:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.137020:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.137028:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa5848c9/0x5475624df454da4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137038:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.137042:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.137047:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa5848c9/0x5475624df454da4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137058:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa5848c9/0x5475624df454da4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137067:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa5848c9/0x5475624df454da4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137074:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa5848c9/0x5475624df454da4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137090:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045565.137098:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.137102:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa5848c9/0x5475624df454da4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137108:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106ea00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.137112:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa5848c9/0x5475624df454da4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137133:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa5848c9/0x5475624df454da4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137147:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa5848c9/0x5475624df454da4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137154:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa5848c9/0x5475624df454da4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137172:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.137174:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.137177:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.137591:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.137597:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c401bc1/0x5475624df454da56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137606:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.137661:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.137667:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c401bc1/0x5475624df454da56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137678:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c401bc1/0x5475624df454da56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137687:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c401bc1/0x5475624df454da56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137706:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c401bc1/0x5475624df454da56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137720:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045565.137729:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.137733:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c401bc1/0x5475624df454da56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137740:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030a00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.137744:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c401bc1/0x5475624df454da56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137752:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c401bc1/0x5475624df454da56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137765:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c401bc1/0x5475624df454da56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137772:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c401bc1/0x5475624df454da56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.137793:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.137795:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.137797:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.138216:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.138231:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfe18b54/0x5475624df454da5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138242:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.138246:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.138251:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe18b54/0x5475624df454da5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138261:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfe18b54/0x5475624df454da5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138270:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfe18b54/0x5475624df454da5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138278:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe18b54/0x5475624df454da5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138295:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045565.138305:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.138309:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfe18b54/0x5475624df454da5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138317:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031a00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.138321:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfe18b54/0x5475624df454da5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138329:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfe18b54/0x5475624df454da5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138359:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfe18b54/0x5475624df454da5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138367:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfe18b54/0x5475624df454da5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138383:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.138385:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.138386:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045565.138764:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045565.138770:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ce2c46f/0x5475624df454da64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138779:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=521s v=(0 0) 00010000:00010000:3.0:1784045565.138781:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045565.138786:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ce2c46f/0x5475624df454da64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138794:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ce2c46f/0x5475624df454da64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138801:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ce2c46f/0x5475624df454da64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138808:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ce2c46f/0x5475624df454da64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138830:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045565.138837:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045565.138840:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ce2c46f/0x5475624df454da64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138847:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030200 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045565.138851:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ce2c46f/0x5475624df454da64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138869:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ce2c46f/0x5475624df454da64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138881:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ce2c46f/0x5475624df454da64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.138888:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ce2c46f/0x5475624df454da64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045565.139058:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.139061:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045565.139062:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1784045565.139114:0:18682:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1784045565.139203:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17197:x1870706873929984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 50206us (50357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045565.139212:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784045565.139266:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17197:1870706873929984:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784045565.139282:0:17197:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1784045565.139323:0:17197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17197:1870706873930112:0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1784045565.142637:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045565.142797:0:17197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045565.142850:0:17197:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784045565.142882:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873930112 00000100:00100000:3.0:1784045565.142889:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873930112 00000100:00100000:3.0:1784045565.143000:0:19104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784045565.143008:0:19104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17197:x1870706873930112:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784045565.143053:0:19104:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:1.0:1784045565.159120:0:18677:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1784045565.159160:0:18677:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784045565.159497:0:19104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17197:x1870706873930112:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16484us (16698us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1784045565.159508:0:17197:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1784045565.159511:0:19104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784045565.159518:0:17197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17197:1870706873930112:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784045565.159537:0:17197:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000040:00080000:0.0:1784045565.465080:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784045565.971716:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045566.996594:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784045567.231582:0:19496:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784045567.231586:0:19496:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1784045567.231588:0:19496:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1784045567.232837:0:19496:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff939cbc5d1000 00000020:01000004:0.0:1784045567.232857:0:19496:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1784045567.232873:0:19496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784045567.232886:0:19496:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff939c901d3380) 00000020:00000080:0.0:1784045567.232905:0:19496:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784045567.338961:0:19496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1784045567.339885:0:19496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784045567.340421:0:19496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1784045567.340773:0:19496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1784045567.340966:0:19496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784045567.341155:0:19496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1784045567.343892:0:19496:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1784045567.346839:0:19496:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784045567.347036:0:19496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1784045567.347051:0:19496:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784045567.347064:0:19496:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5475624df454da72 00000020:01000004:0.0:1784045567.347070:0:19496:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1784045567.347090:0:19496:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.144@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1784045567.347093:0:19496:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1784045567.347099:0:19496:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1784045567.347125:0:19496:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1784045567.347129:0:19496:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.144@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1784045567.354979:0:19496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.144@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784045567.355015:0:19496:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.144@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1784045567.355020:0:19496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784045567.355022:0:19496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784045567.355024:0:19496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045567.355025:0:19496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045567.355026:0:19496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045567.355027:0:19496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045567.355028:0:19496:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045567.355031:0:19496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045567.355032:0:19496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784045567.355036:0:19496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1784045567.355038:0:19496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784045567.355040:0:19496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784045567.355041:0:19496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784045567.355042:0:19496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784045567.355043:0:19496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784045567.355044:0:19496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784045567.355046:0:19496:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784045567.355047:0:19496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784045567.355048:0:19496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784045567.355074:0:19496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784045567.355098:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873930240:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784045567.355170:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045567.355216:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939ca0004a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784045567.355288:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873930240 00000100:00100000:2.0:1784045567.355295:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873930240 00000100:00100000:2.0:1784045567.355384:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784045567.355394:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+21:19496:x1870706873930240:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784045567.355424:0:17166:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1784045567.355427:0:17166:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1784045567.355432:0:17166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1784045567.355759:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+21:19496:x1870706873930240:12345-0@lo:253:mount.lustre.0 Request processed in 366us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045567.355768:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784045567.355852:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873930240:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784045567.355863:0:19496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784045567.355865:0:19496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784045567.355867:0:19496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784045567.355868:0:19496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784045567.355869:0:19496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784045567.355870:0:19496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784045567.355872:0:19496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784045567.355873:0:19496:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784045567.355874:0:19496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784045567.355875:0:19496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784045567.355893:0:19496:0:(tgt_mount.c:101:server_register_mount()) register mount ffff939cbc5d1000 from lustre-OST0001 10000000:01000000:1.0:1784045567.355922:0:19496:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1784045567.355930:0:19496:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784045567.355938:0:19496:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff939b832619c0 local copy 00010000:00010000:1.0:1784045567.355947:0:19496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6cf expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045567.356025:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873930368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045567.356052:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045567.356210:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045567.356285:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873930368 00000100:00100000:0.0:1784045567.356290:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873930368 00000100:00100000:0.0:1784045567.356314:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784045567.356320:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:19496:x1870706873930368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045567.356423:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:19496:x1870706873930368:12345-0@lo:501:mount.lustre.0 Request processed in 103us (370us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784045567.356430:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1784045567.356514:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873930368:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784045567.356526:0:19496:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784045567.356542:0:19496:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784045567.356548:0:19496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6cf expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.356557:0:19496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c918b2800/0x5475624df454d6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454d6cf expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045567.356580:0:19496:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff939cbc5d1000 10000000:01000000:1.0:1784045567.356585:0:19496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784045567.356589:0:19496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784045567.356592:0:19496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784045567.356596:0:19496:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1784045567.356608:0:19496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784045567.356629:0:19496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454da79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.356637:0:19496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454da79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.356658:0:19496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454da79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045567.356672:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873930496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784045567.356698:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045567.356722:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045567.356765:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873930496 00000100:00100000:0.0:1784045567.356769:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873930496 00000100:00100000:0.0:1784045567.356785:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784045567.356789:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:19496:x1870706873930496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784045567.356797:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045567.356808:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c918b3000/0x5475624df454da80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454da79 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045567.356827:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c918b3000/0x5475624df454da80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454da79 expref: 22 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045567.356836:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c918b3000/0x5475624df454da80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454da79 expref: 22 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045567.356844:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b3000, rc 0) 00000100:00100000:0.0:1784045567.356876:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+22:19496:x1870706873930496:12345-0@lo:101:mount.lustre.0 Request processed in 86us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.356882:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784045567.356947:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873930496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045567.356958:0:19496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454da79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454da80 expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.356967:0:19496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454da79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454da80 expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784045567.357868:0:19496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1784045567.358365:0:19496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045567.360730:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1784045567.360790:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1784045567.360807:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1784045567.360819:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1784045567.360828:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1784045567.360838:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1784045567.360859:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1784045567.360863:0:19496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1784045567.360960:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873930624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045567.361021:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045567.361108:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d1240 going to sleep for 11 seconds 00000100:00100000:0.0:1784045567.361205:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873930624 00000100:00100000:0.0:1784045567.361212:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873930624 00000100:00100000:0.0:1784045567.361297:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784045567.361306:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+22:19496:x1870706873930624:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045567.361633:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+22:19496:x1870706873930624:12345-0@lo:501:mount.lustre.0 Request processed in 328us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.361641:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784045567.361760:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873930624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784045567.361798:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873930752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784045567.362018:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045567.362049:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d1240 going to sleep for 11 seconds 00000100:00100000:3.0:1784045567.362112:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873930752 00000100:00100000:3.0:1784045567.362116:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873930752 00000100:00100000:3.0:1784045567.362151:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784045567.362158:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+22:19496:x1870706873930752:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784045567.362895:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+22:19496:x1870706873930752:12345-0@lo:503:mount.lustre.0 Request processed in 736us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045567.362903:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784045567.362987:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873930752:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784045567.363438:0:19496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784045567.363534:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873930880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784045567.363578:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045567.363617:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d1240 going to sleep for 11 seconds 00000100:00100000:0.0:1784045567.363749:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873930880 00000100:00100000:0.0:1784045567.363755:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873930880 00000100:00100000:0.0:1784045567.363793:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784045567.363802:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+22:19496:x1870706873930880:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045567.364206:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+22:19496:x1870706873930880:12345-0@lo:502:mount.lustre.0 Request processed in 405us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.364214:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784045567.364289:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873930880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784045567.364511:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1784045567.364542:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1784045567.364556:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1784045567.364568:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1784045567.364581:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1784045567.364594:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1784045567.364618:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1784045567.364635:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1784045567.364647:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1784045567.364668:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784045567.364702:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045567.364726:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b833d1240 going to sleep for 11 seconds 00000100:00100000:0.0:1784045567.364845:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873931008 00000100:00100000:0.0:1784045567.364850:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873931008 00000100:00100000:0.0:1784045567.364869:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784045567.364875:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+22:19496:x1870706873931008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045567.364945:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+22:19496:x1870706873931008:12345-0@lo:502:mount.lustre.0 Request processed in 70us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.364953:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784045567.365118:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784045567.365155:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1784045567.365162:0:19496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1784045567.365837:0:19500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784045567.365845:0:19500:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1784045567.365856:0:19500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045567.365858:0:19500:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1784045567.365864:0:19500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784045567.365877:0:19500:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff939cc13a3380) 00000020:00000080:1.0:1784045567.365900:0:19500:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1784045567.365905:0:19500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784045567.365976:0:19500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939cbc5d1000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1784045567.365984:0:19500:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784045567.365989:0:19500:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5475624df454da8e 00010000:00010000:1.0:1784045567.373130:0:19500:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1784045567.373746:0:19500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1784045567.375016:0:19500:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1784045567.376183:0:19500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1784045567.376193:0:19500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045567.376198:0:19500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045567.376200:0:19500:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1784045567.376203:0:19500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045567.376207:0:19500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045567.376209:0:19500:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784045567.376211:0:19500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784045567.376213:0:19500:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784045567.376215:0:19500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045567.376219:0:19500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045567.376221:0:19500:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784045567.376223:0:19500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784045567.376224:0:19500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045567.376226:0:19500:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784045567.376228:0:19500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1784045567.376251:0:19500:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784045567.376253:0:19500:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784045567.376255:0:19500:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784045567.376257:0:19500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1784045567.376417:0:19496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1784045567.376471:0:19496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784045567.376495:0:19496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454da79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454da80 expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045567.376506:0:19496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b836cd800/0x5475624df454da79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454da80 expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045567.376513:0:19496:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939cbc5d1000 from 1 10000000:01000000:2.0:1784045567.376516:0:19496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784045567.376549:0:19496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045567.376565:0:19496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045567.376577:0:19496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045567.376756:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784045567.376824:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045567.376870:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc12330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045567.376926:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873931136 00000100:00100000:1.0:1784045567.376939:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873931136 00000100:00100000:1.0:1784045567.376986:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784045567.376995:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+22:19496:x1870706873931136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045567.377008:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045567.377020:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b836cda00/0x5475624df454da9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454da95 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.377042:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836cda00/0x5475624df454da9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454da95 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.377052:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b836cda00/0x5475624df454da9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454da95 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.377061:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cda00, rc 0) 00000100:00100000:1.0:1784045567.377106:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+23:19496:x1870706873931136:12345-0@lo:101:mount.lustre.0 Request processed in 113us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045567.377114:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784045567.377226:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784045567.377241:0:19496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454da9c expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045567.377249:0:19496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454da9c expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784045567.385078:0:19496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1784045567.385864:0:19496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784045567.386110:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1784045567.386138:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1784045567.386157:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1784045567.386162:0:19496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1784045567.386236:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045567.387593:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045567.387775:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc1233e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045567.390867:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873931264 00000100:00100000:3.0:1784045567.390880:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873931264 00000100:00100000:3.0:1784045567.390966:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784045567.390975:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+23:19496:x1870706873931264:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784045567.391128:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+23:19496:x1870706873931264:12345-0@lo:501:mount.lustre.0 Request processed in 154us (3683us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045567.391147:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784045567.391282:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045567.391327:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045567.391385:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045567.391882:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc1233e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784045567.391965:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873931392 00000100:00100000:1.0:1784045567.391970:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873931392 00000100:00100000:1.0:1784045567.391995:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784045567.392002:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+23:19496:x1870706873931392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784045567.392092:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+23:19496:x1870706873931392:12345-0@lo:503:mount.lustre.0 Request processed in 90us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045567.392099:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784045567.392472:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931392:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784045567.392838:0:19496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784045567.392905:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045567.392946:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045567.392965:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc12330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045567.393214:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873931520 00000100:00100000:1.0:1784045567.393219:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873931520 00000100:00100000:1.0:1784045567.393241:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784045567.393247:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+23:19496:x1870706873931520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784045567.393356:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+23:19496:x1870706873931520:12345-0@lo:502:mount.lustre.0 Request processed in 108us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045567.393362:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1784045567.396031:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931520:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784045567.396300:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1784045567.396333:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1784045567.396361:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1784045567.396375:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1784045567.396392:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1784045567.396406:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1784045567.396419:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1784045567.396433:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1784045567.396468:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1784045567.396486:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1784045567.396501:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1784045567.396687:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045567.396759:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045567.396801:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc12330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045567.396946:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873931648 00000100:00100000:1.0:1784045567.396953:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873931648 00000100:00100000:1.0:1784045567.396992:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784045567.397001:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+23:19496:x1870706873931648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784045567.397147:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+23:19496:x1870706873931648:12345-0@lo:502:mount.lustre.0 Request processed in 146us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045567.397155:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784045567.397227:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784045567.397344:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1784045567.397356:0:19496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1784045567.403356:0:19504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045567.403369:0:19504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045567.403371:0:19504:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784045567.403377:0:19504:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939cbc5d1000 00000020:00000080:0.0:1784045567.403380:0:19504:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784045567.403387:0:19504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045567.403389:0:19504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045567.403397:0:19504:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784045567.403401:0:19504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045567.403403:0:19504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045567.403405:0:19504:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784045567.403408:0:19504:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff939cbc5d1000 00000020:00000080:0.0:1784045567.403410:0:19504:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784045567.403767:0:19504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045567.405505:0:19504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045567.405511:0:19504:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784045567.405529:0:19504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045567.405534:0:19504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045567.405535:0:19504:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784045567.405540:0:19504:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939cbc5d1000 00000020:00000080:0.0:1784045567.405542:0:19504:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784045567.405580:0:19504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045567.405583:0:19504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045567.405584:0:19504:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784045567.405586:0:19504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784045567.405588:0:19504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045567.405590:0:19504:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1784045567.405592:0:19504:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff939cbc5d1000 00000020:00000080:0.0:1784045567.405594:0:19504:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784045567.406407:0:19504:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784045567.406412:0:19504:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784045567.406414:0:19504:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1784045567.406417:0:19504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1784045567.406745:0:19496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1784045567.406775:0:19496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784045567.406797:0:19496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454da9c expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045567.406809:0:19496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454da9c expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045567.406873:0:19496:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784045567.406876:0:19496:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff939cbc5d1000 10000000:01000000:3.0:1784045567.406878:0:19496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff939cbc5d1000 10000000:01000000:3.0:1784045567.406882:0:19496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784045567.406887:0:19496:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff939cbc5d1000 from 1 10000000:01000000:3.0:1784045567.406890:0:19496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784045567.406921:0:19496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c80030200/0x5475624df454daa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045567.406929:0:19496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c80030200/0x5475624df454daa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045567.406939:0:19496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c80030200/0x5475624df454daa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045567.406961:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784045567.407015:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045567.407048:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b8307a840 going to sleep for 11 seconds 00000100:00100000:1.0:1784045567.414076:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873931776 00000100:00100000:1.0:1784045567.414090:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873931776 00000100:00100000:1.0:1784045567.414161:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784045567.414171:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+23:19496:x1870706873931776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784045567.416377:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045567.416402:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b836cde00/0x5475624df454daaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454daa3 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.416434:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836cde00/0x5475624df454daaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454daa3 expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.417375:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b836cde00/0x5475624df454daaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454daa3 expref: 24 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.417389:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cde00, rc 0) 00000100:00100000:1.0:1784045567.417671:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+24:19496:x1870706873931776:12345-0@lo:101:mount.lustre.0 Request processed in 3499us (10653us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045567.417689:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784045567.420896:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784045567.420926:0:19496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c80030200/0x5475624df454daa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454daaa expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045567.420945:0:19496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c80030200/0x5475624df454daa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454daaa expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784045567.425296:0:19496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1784045567.425782:0:19496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784045567.425952:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1784045567.425973:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1784045567.425984:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1784045567.426870:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1784045567.426892:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1784045567.426903:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1784045567.426913:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1784045567.426923:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1784045567.426934:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1784045567.426944:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1784045567.426955:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1784045567.426965:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1784045567.426976:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1784045567.426986:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1784045567.426996:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1784045567.427006:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1784045567.427017:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1784045567.427027:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1784045567.427037:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1784045567.427064:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1784045567.427079:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1784045567.427092:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1784045567.427105:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1784045567.427118:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1784045567.427769:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1784045567.427793:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1784045567.427807:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1784045567.427821:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1784045567.427833:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1784045567.427845:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1784045567.427855:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1784045567.427866:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1784045567.427876:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1784045567.427896:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1784045567.427907:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1784045567.427928:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1784045567.427939:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1784045567.427949:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1784045567.427960:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1784045567.427970:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1784045567.427980:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1784045567.427990:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1784045567.428000:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1784045567.428010:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1784045567.428021:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1784045567.428031:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1784045567.428050:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1784045567.428054:0:19496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1784045567.428794:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045567.428857:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045567.428902:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc12330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045567.429422:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873931904 00000100:00100000:0.0:1784045567.429430:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873931904 00000100:00100000:0.0:1784045567.429499:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784045567.429507:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+24:19496:x1870706873931904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784045567.429644:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+24:19496:x1870706873931904:12345-0@lo:501:mount.lustre.0 Request processed in 137us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.429661:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784045567.429784:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873931904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784045567.429822:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873932032:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784045567.429859:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045567.429879:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc12330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045567.429939:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873932032 00000100:00100000:1.0:1784045567.429944:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873932032 00000100:00100000:1.0:1784045567.429962:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784045567.429967:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+25:19496:x1870706873932032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784045567.430041:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+25:19496:x1870706873932032:12345-0@lo:503:mount.lustre.0 Request processed in 73us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045567.430047:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784045567.430318:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873932032:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784045567.431572:0:19496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784045567.431656:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873932160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045567.432413:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045567.432481:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc12330c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045567.432776:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873932160 00000100:00100000:1.0:1784045567.432784:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873932160 00000100:00100000:1.0:1784045567.432834:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784045567.432842:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+24:19496:x1870706873932160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784045567.432997:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+24:19496:x1870706873932160:12345-0@lo:502:mount.lustre.0 Request processed in 156us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045567.433005:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784045567.435230:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873932160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784045567.435621:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1784045567.435734:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1784045567.435764:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1784045567.435780:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1784045567.435793:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1784045567.435808:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1784045567.435819:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1784045567.435831:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1784045567.435843:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1784045567.435856:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1784045567.435873:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1784045567.435885:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1784045567.435897:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1784045567.435909:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1784045567.435923:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1784045567.435934:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1784045567.435946:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1784045567.435972:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1784045567.435985:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1784045567.435996:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1784045567.436007:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1784045567.436019:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1784045567.436032:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1784045567.436043:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1784045567.436056:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1784045567.436069:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1784045567.436080:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1784045567.436091:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1784045567.436103:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1784045567.436115:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1784045567.436290:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1784045567.436313:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1784045567.436407:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1784045567.436438:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1784045567.436474:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1784045567.436486:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1784045567.436496:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1784045567.436507:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1784045567.436518:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1784045567.436530:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1784045567.436541:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1784045567.436550:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1784045567.436560:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1784045567.436570:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1784045567.436581:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1784045567.436592:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1784045567.436604:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1784045567.436616:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1784045567.436747:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873932288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045567.436814:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045567.436846:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc12330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045567.438111:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873932288 00000100:00100000:0.0:1784045567.438121:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873932288 00000100:00100000:0.0:1784045567.438332:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784045567.438353:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+24:19496:x1870706873932288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045567.438526:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+24:19496:x1870706873932288:12345-0@lo:502:mount.lustre.0 Request processed in 176us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.438534:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784045567.439373:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873932288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784045567.439859:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1784045567.439890:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1784045567.439927:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873932416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784045567.439982:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045567.440024:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc12330c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045567.440106:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873932416 00000100:00100000:0.0:1784045567.440113:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873932416 00000100:00100000:0.0:1784045567.440184:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784045567.440192:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+24:19496:x1870706873932416:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784045567.440299:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+24:19496:x1870706873932416:12345-0@lo:502:mount.lustre.0 Request processed in 107us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.440305:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784045567.440377:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82881180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873932416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784045567.440416:0:19496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1784045567.440424:0:19496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1784045567.441252:0:19510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1784045567.441264:0:19510:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff939c901d19c0) 00000020:00000080:0.0:1784045567.441286:0:19510:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1784045567.441557:0:19510:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939cbc5d1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784045567.441561:0:19510:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939cbc5d1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784045567.441564:0:19510:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939cbc5d1000 3 00010000:00080000:0.0:1784045567.441593:0:19510:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939b83637000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.144@tcp at head 00010000:00010000:0.0:1784045567.446438:0:19510:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1784045567.446622:0:19510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1784045567.446665:0:19510:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784045567.446739:0:19510:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5475624df454dab8 00000100:00080000:0.0:1784045567.446749:0:19510:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784045567.446761:0:19510:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff939b83637000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:0.0:1784045567.446794:0:19510:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b82a8c000 x1870706873932544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784045567.446848:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1870706873932544:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784045567.446917:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784045567.446976:0:19510:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784045567.447145:0:18435:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045567.447149:0:18435:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784045567.447152:0:18435:0:(import.c:65:import_set_state_nolock()) ffff939cb5a99000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045567.447157:0:18435:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1784045567.447160:0:18435:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784045567.447163:0:18435:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939cb5a99000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045567.447176:0:18435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b841c4380 x1870706873932928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045567.447210:0:18435:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784045567.447213:0:18435:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784045567.447214:0:18435:0:(import.c:65:import_set_state_nolock()) ffff939cb59c2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784045567.447218:0:18435:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1784045567.447220:0:18435:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1784045567.447224:0:18435:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939cb59c2000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045567.447233:0:18435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b841c7480 x1870706873933440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784045567.447267:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873932928:0@lo:8:kworker.0 00000100:00100000:3.0:1784045567.447294:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045567.447321:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873933440:0@lo:8:kworker.0 00000100:00100000:2.0:1784045567.447377:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873932928 00000100:00100000:2.0:1784045567.447389:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873932928 00000100:00100000:2.0:1784045567.447425:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784045567.447428:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873932672:0@lo:400:kworker.0 00000100:00100000:2.0:1784045567.447432:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1870706873932928:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1784045567.450723:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045567.450970:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1870706873932928:12345-0@lo:8:kworker.0 Request processed in 3534us (3671us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784045567.450982:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784045567.451008:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873933440 00000100:00100000:2.0:1784045567.451015:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873933440 00000100:00100000:2.0:1784045567.451041:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045567.451047:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1870706873933440:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1784045567.451098:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1870706873933440:12345-0@lo:8:kworker.0 Request processed in 51us (381us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784045567.451103:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045567.451121:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873932544 00000100:00100000:2.0:1784045567.451125:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873932544 00000100:00100000:2.0:1784045567.451143:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784045567.451148:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1870706873932544:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784045567.451161:0:17172:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1784045567.451193:0:17172:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5475624df454dabf 00000004:00100000:2.0:1784045567.451206:0:17172:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784045567.451237:0:17172:0:(import.c:65:import_set_state_nolock()) ffff939cb59c0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045567.451277:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1870706873932544:12345-0@lo:38:llog_process_th.0 Request processed in 127us (4359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045567.451283:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045567.451426:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045567.451491:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873933312:0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.451519:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045567.451541:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784045567.451546:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873932800:0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.451567:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045567.451584:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873933568:0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.451603:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045567.451631:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873933056:0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.451652:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045567.451684:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873933696:0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.451704:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045567.451721:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784045567.451727:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873933184:0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.451747:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045567.451764:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873933824:0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.451782:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045567.451807:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873933312 00000100:00100000:0.0:1784045567.451811:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873933312 00000100:00100000:0.0:1784045567.451848:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873932800 00000100:00100000:0.0:1784045567.451858:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873932800 00000100:00100000:0.0:1784045567.451877:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045567.451882:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873933312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.451919:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873933312:12345-0@lo:400:kworker.0 Request processed in 38us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.451925:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784045567.451936:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045567.451942:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873932800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.451967:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873932800:12345-0@lo:400:kworker.0 Request processed in 25us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.451973:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784045567.451989:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873932672 00000100:00100000:0.0:1784045567.451992:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873932672 00000100:00100000:0.0:1784045567.452013:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873933184 00000100:00100000:0.0:1784045567.452016:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873933184 00000100:00100000:0.0:1784045567.452027:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784045567.452032:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873932672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.452060:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873932672:12345-0@lo:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.452065:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784045567.452076:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784045567.452080:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873933184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.452105:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873933184:12345-0@lo:400:kworker.0 Request processed in 24us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.452110:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784045567.452125:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873933568 00000100:00100000:0.0:1784045567.452128:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873933568 00000100:00100000:0.0:1784045567.452149:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873933056 00000100:00100000:0.0:1784045567.452151:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873933056 00000100:00100000:0.0:1784045567.452158:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873933696 00000100:00100000:0.0:1784045567.452160:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873933696 00000100:00100000:0.0:1784045567.452170:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873933824 00000100:00100000:0.0:1784045567.452172:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873933824 00000100:00100000:0.0:1784045567.452182:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784045567.452187:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873933568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.452211:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873933568:12345-0@lo:400:kworker.0 Request processed in 24us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.452216:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784045567.452226:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784045567.452231:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873933056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.452255:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1870706873933056:12345-0@lo:400:kworker.0 Request processed in 24us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.452260:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784045567.452290:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784045567.452296:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873933696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.452320:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1870706873933696:12345-0@lo:400:kworker.0 Request processed in 25us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.452326:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784045567.452352:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784045567.452358:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873933824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.452383:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873933824:12345-0@lo:400:kworker.0 Request processed in 26us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045567.452388:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1784045567.452417:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784045567.452426:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045567.452429:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045567.452482:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873933184:0@lo:400:kworker.0 00010000:00080000:0.0:1784045567.452494:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b841c5f80 x1870706873933824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045567.452504:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873933824:0@lo:400:kworker.0 00010000:00080000:0.0:1784045567.452512:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b841c4000 x1870706873933056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045567.452519:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1870706873933056:0@lo:400:kworker.0 00010000:00080000:0.0:1784045567.452528:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b841c6d80 x1870706873933696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045567.452535:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1870706873933696:0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.452641:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873932800:0@lo:400:kworker.0 00010000:00080000:0.0:1784045567.452650:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b841c5500 x1870706873933568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045583 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045567.452658:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873933568:0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.452667:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873932672:0@lo:400:kworker.0 00000100:00100000:0.0:1784045567.452677:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873933312:0@lo:400:kworker.0 00000020:01000004:0.0:1784045567.452765:0:19510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1784045567.452778:0:19510:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff939c901d0000) 00000020:00000080:0.0:1784045567.452795:0:19510:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:3.0:1784045567.455974:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784045567.455986:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb5a99000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045567.455993:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784045567.455998:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873932928:0@lo:8:kworker.0 00000100:00100000:3.0:1784045567.456009:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784045567.456013:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb59c2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784045567.456016:0:3622:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784045567.456020:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873933440:0@lo:8:kworker.0 00010000:00080000:3.0:1784045567.456035:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b82a8c000 x1870706873932544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045567.456044:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784045567.456050:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1784045567.456059:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784045567.456064:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784045567.456067:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b83637000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784045567.456072:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82a8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1870706873932544:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1784045567.456746:0:19510:0:(tgt_mount.c:153:server_get_mount()) get mount ffff939cbc5d1000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784045567.456751:0:19510:0:(tgt_mount.c:187:server_put_mount()) put mount ffff939cbc5d1000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1784045567.456755:0:19510:0:(obd_mount.c:710:lustre_put_lsi()) put ffff939cbc5d1000 3 00010000:00080000:3.0:1784045567.456788:0:19510:0:(ldlm_lib.c:102:import_set_conn()) imp ffff939b841fe000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.144@tcp at head 00010000:00010000:3.0:1784045567.460159:0:19510:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1784045567.460282:0:19510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1784045567.460353:0:19510:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784045567.460370:0:19510:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5475624df454dacd 00000100:00080000:3.0:1784045567.460381:0:19510:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784045567.460387:0:19510:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff939b841fe000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:3.0:1784045567.460421:0:19510:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b841c7480 x1870706873933952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784045567.460470:0:19510:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1784045567.460779:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1870706873933952:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784045567.460860:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045567.460979:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873933952 00000100:00100000:1.0:1784045567.460986:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873933952 00000100:00100000:1.0:1784045567.461021:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784045567.461029:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1870706873933952:12345-0@lo:38:llog_process_th.0 00000040:00080000:2.0:1784045567.461044:0:19510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00010000:00080000:1.0:1784045567.461052:0:17174:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:1.0:1784045567.461080:0:17174:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5475624df454dad4 00000004:00100000:1.0:1784045567.461092:0:17174:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784045567.461118:0:17174:0:(import.c:65:import_set_state_nolock()) ffff939cbb6a5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784045567.461181:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1870706873933952:12345-0@lo:38:llog_process_th.0 Request processed in 151us (320us total) trans 0 rc 0/0 00010000:00080000:0.0:1784045567.461185:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff939b841c7480 x1870706873933952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784045577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045567.461195:0:3622:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:1.0:1784045567.461197:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1784045567.461202:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1784045567.461208:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784045567.461212:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784045567.461214:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939b841fe000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784045567.461220:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1870706873933952:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1784045567.461256:0:19496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1784045567.461284:0:19496:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784045567.461303:0:19496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c80030200/0x5475624df454daa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454daaa expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045567.461315:0:19496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c80030200/0x5475624df454daa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454daaa expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784045567.461370:0:19496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784045567.461373:0:19496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784045567.461374:0:19496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045567.461376:0:19496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045567.461377:0:19496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045567.461378:0:19496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045567.461380:0:19496:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045567.461381:0:19496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045567.461383:0:19496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784045567.461387:0:19496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1784045567.461389:0:19496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784045567.461391:0:19496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784045567.461392:0:19496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045567.461393:0:19496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784045567.461612:0:19496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045567.461615:0:19496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045567.461616:0:19496:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045567.461617:0:19496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045567.461618:0:19496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784045567.461637:0:19496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784045567.461655:0:19496:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873934080:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784045567.461705:0:19496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045567.461733:0:19496:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b8307a780 going to sleep for 11 seconds 00000100:00100000:1.0:1784045567.461734:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873934080 00000100:00100000:1.0:1784045567.461738:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873934080 00000100:00100000:1.0:1784045567.461815:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784045567.461823:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+24:19496:x1870706873934080:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784045567.461847:0:17166:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784045567.461862:0:17166:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784045567.473821:0:17166:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784045567.473868:0:17166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784045567.474162:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+24:19496:x1870706873934080:12345-0@lo:253:mount.lustre.0 Request processed in 12336us (12452us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045567.474175:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 20000000:01000000:0.0:1784045567.474242:0:17188:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784045567.474247:0:17188:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:3.0:1784045567.474253:0:19496:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c25407c2-0928-423d-881e-1585e6e3cc3c:19496:1870706873934080:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784045567.474266:0:19496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784045567.474270:0:19496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784045567.474272:0:19496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784045567.474274:0:19496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784045567.474276:0:19496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:0.0:1784045567.474276:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784045567.474277:0:19496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784045567.474279:0:19496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784045567.474280:0:19496:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784045567.474282:0:19496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784045567.474284:0:19496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:0.0:1784045567.474290:0:17188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c918b3a00/0x5475624df454d98b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d984 expref: 23 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1784045567.474297:0:19496:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1784045567.474298:0:17188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b81986400/0x5475624df454d999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d992 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045567.474306:0:17188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045567.474352:0:17188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b81986400/0x5475624df454d999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454d992 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045567.474365:0:17188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939b81986400/0x5475624df454d999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454d992 expref: 23 pid: 17166 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045567.474396:0:17188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873934208:0@lo:104: 00000100:00100000:0.0:1784045567.474430:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784045567.474558:0:17188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c918b3a00/0x5475624df454d98b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454d984 expref: 23 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045567.474567:0:17188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939c918b3a00/0x5475624df454d98b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454d984 expref: 23 pid: 17164 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045567.474576:0:17188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873934336:0@lo:104: 00000100:00100000:0.0:1784045567.474683:0:17188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045567.474873:0:17188:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c83d633c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045567.474947:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873934208 00000100:00100000:1.0:1784045567.474954:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873934208 00000100:00100000:1.0:1784045567.474985:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873934336 00000100:00100000:1.0:1784045567.474988:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873934336 00000100:00100000:1.0:1784045567.475003:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784045567.475012:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+4:17188:x1870706873934208:12345-0@lo:104: 00010000:00010000:1.0:1784045567.475024:0:17156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d999 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475080:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784045567.475085:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+4:17188:x1870706873934208:12345-0@lo:104: Request processed in 75us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045567.475092:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784045567.475109:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784045567.475115:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+3:17188:x1870706873934336:12345-0@lo:104: 00010000:00010000:1.0:1784045567.475134:0:17156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d98b expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475168:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784045567.475172:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+3:17188:x1870706873934336:12345-0@lo:104: Request processed in 58us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045567.475179:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1784045567.475196:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784045567.475202:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d999 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475209:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987600 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045567.475214:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454d999 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475222:0:17160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454d999 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045567.475229:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454d999 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045567.475234:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045567.475325:0:17160:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d999 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475331:0:17160:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045567.475359:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d999 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475365:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81987600/0x5475624df454d992 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d999 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475384:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045567.475387:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d98b expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475392:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986a00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:1.0:1784045567.475395:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454d98b expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475401:0:17160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454d98b expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784045567.475407:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454d98b expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045567.475412:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784045567.475425:0:17160:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d98b expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475431:0:17160:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784045567.475438:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d98b expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475478:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81986a00/0x5475624df454d984 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d98b expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475489:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045567.475491:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045567.475492:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045567.475498:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045567.475515:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c25407c2-0928-423d-881e-1585e6e3cc3c:3626:1870706873934592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045567.475555:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045567.475582:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045567.475586:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c25407c2-0928-423d-881e-1585e6e3cc3c:3626:1870706873934464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045567.475603:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045567.475629:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873934592 00000100:00100000:1.0:1784045567.475633:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873934592 00010000:00010000:1.0:1784045567.475649:0:17927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c918b3a00/0x5475624df454d98b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d984 expref: 24 pid: 17164 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045567.475667:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873934464 00000100:00100000:1.0:1784045567.475670:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873934464 00010000:00010000:1.0:1784045567.475680:0:17927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b81986400/0x5475624df454d999 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d992 expref: 25 pid: 17166 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045567.475695:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784045567.475701:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c25407c2-0928-423d-881e-1585e6e3cc3c+25:3626:x1870706873934592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045567.475711:0:17927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045567.475716:0:17927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c918b3a00/0x5475624df454d98b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d984 expref: 25 pid: 17164 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475725:0:17927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c918b3a00/0x5475624df454d98b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454d984 expref: 25 pid: 17164 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475738:0:17927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045567.475765:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c25407c2-0928-423d-881e-1585e6e3cc3c+25:3626:x1870706873934592:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045567.475771:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784045567.475786:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784045567.475792:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c25407c2-0928-423d-881e-1585e6e3cc3c+24:3626:x1870706873934464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045567.475805:0:17927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045567.475809:0:17927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b81986400/0x5475624df454d999 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d992 expref: 24 pid: 17166 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475818:0:17927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b81986400/0x5475624df454d999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454d992 expref: 24 pid: 17166 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475829:0:17927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475837:0:17927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784045567.475850:0:17927:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015662686s 00010000:00010000:1.0:1784045567.475855:0:17927:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475862:0:17927:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475869:0:17927:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475875:0:17927:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475881:0:17927:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2a00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045567.475885:0:17927:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475892:0:17927:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475908:0:17927:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045567.475917:0:17927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045567.475939:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c25407c2-0928-423d-881e-1585e6e3cc3c+24:3626:x1870706873934464:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045567.475946:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784045567.476000:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c25407c2-0928-423d-881e-1585e6e3cc3c:3626:1870706873934464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784045567.476009:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c25407c2-0928-423d-881e-1585e6e3cc3c:3626:1870706873934592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045567.476166:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81986400/0x5475624df454d999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454d992 expref: 23 pid: 17166 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045567.476177:0:17188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873934208:0@lo:104: 00010000:00010000:0.0:1784045567.476186:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c918b3a00/0x5475624df454d98b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454d984 expref: 22 pid: 17164 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045567.476195:0:17188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17188:1870706873934336:0@lo:104: 00010000:00010000:0.0:1784045567.476209:0:17188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045567.476217:0:17188:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045567.476224:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045567.476240:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c918b2a00/0x5475624df454dadb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1784045567.495093:0:19496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1784045567.503787:0:19496:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1784045567.503798:0:19496:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1784045567.503837:0:19496:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784045567.504440:0:19496:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.144@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784045567.504787:0:19496:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1784045567.504816:0:19496:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1784045567.508290:0:19496:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784045567.511195:0:19496:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784045568.019657:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784045568.466170:0:19563:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045568.466882:0:19563:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1784045568.788603:0:17169:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784045568.788611:0:17169:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939c92653800 from 10 10000000:01000000:1.0:1784045568.788617:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784045568.788668:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cc800/0x5475624df454dae2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045568.788680:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b836cc800/0x5475624df454dae2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045568.788692:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b836cc800/0x5475624df454dae2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045568.788719:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873934720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045568.788795:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045568.788853:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045568.788914:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873934720 00000100:00100000:0.0:1784045568.788921:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873934720 00000100:00100000:0.0:1784045568.788988:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784045568.788998:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+22:17169:x1870706873934720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045568.789011:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045568.789026:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c918b3a00/0x5475624df454dae9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454dae2 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045568.789050:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c918b3a00/0x5475624df454dae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454dae2 expref: 23 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045568.789059:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c918b3a00/0x5475624df454dae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454dae2 expref: 23 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045568.789067:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b3a00, rc 0) 00000100:00100000:0.0:1784045568.789113:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+23:17169:x1870706873934720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045568.789121:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784045568.789165:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873934720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045568.789180:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b836cc800/0x5475624df454dae2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dae9 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045568.789188:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b836cc800/0x5475624df454dae2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454dae9 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045568.789250:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873934848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784045568.789279:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045568.789296:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a60cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045568.789311:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873934848 00000100:00100000:0.0:1784045568.789315:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873934848 00000100:00100000:0.0:1784045568.789350:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784045568.789356:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+23:17169:x1870706873934848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784045568.789370:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784045568.789388:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784045568.789391:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1784045568.789516:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+23:17169:x1870706873934848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 159us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045568.789522:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784045568.789553:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873934848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784045568.789606:0:17169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784045568.789612:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b836cc800/0x5475624df454dae2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dae9 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045568.789620:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b836cc800/0x5475624df454dae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dae9 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784045568.789628:0:17169:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784045568.789630:0:17169:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff939b840c4000 from 10 10000000:01000000:0.0:1784045568.789633:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784045568.789647:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2a00/0x5475624df454daf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045568.789663:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c918b2a00/0x5475624df454daf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045568.789671:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c918b2a00/0x5475624df454daf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045568.789683:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873934976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784045568.789707:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045568.789721:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a60cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045568.789733:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873934976 00000100:00100000:0.0:1784045568.789736:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873934976 00000100:00100000:0.0:1784045568.789758:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784045568.789763:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+23:17169:x1870706873934976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045568.789770:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045568.789778:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c918b3400/0x5475624df454daf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454daf0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045568.789794:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c918b3400/0x5475624df454daf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454daf0 expref: 24 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045568.789802:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c918b3400/0x5475624df454daf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454daf0 expref: 24 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045568.789808:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c918b3400, rc 0) 00000100:00100000:0.0:1784045568.789836:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+24:17169:x1870706873934976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045568.789842:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784045568.789878:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873934976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045568.789889:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c918b2a00/0x5475624df454daf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454daf7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045568.789897:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c918b2a00/0x5475624df454daf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454daf7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045568.789931:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873935104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784045568.789959:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045568.789972:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb5a60cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045568.789983:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873935104 00000100:00100000:0.0:1784045568.789986:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873935104 00000100:00100000:0.0:1784045568.790004:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784045568.790010:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+24:17169:x1870706873935104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784045568.790020:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784045568.790029:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784045568.790032:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1784045568.790088:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+24:17169:x1870706873935104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045568.790094:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784045568.790121:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873935104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784045568.790157:0:17169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784045568.790162:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c918b2a00/0x5475624df454daf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454daf7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045568.790170:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c918b2a00/0x5475624df454daf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454daf7 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045569.043638:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045569.179500:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873935232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045569.179567:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045569.180257:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873935232 00000100:00100000:1.0:1784045569.180266:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873935232 00000100:00100000:1.0:1784045569.180362:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784045569.180371:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873935232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045569.180403:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784045569.180478:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873935232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045569.180485:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1784045569.180909:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045569.181122:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873935232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045569.684847:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045569.684873:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873935360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045569.684939:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045569.687432:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873935488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045569.687523:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045569.687584:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873935360 00000100:00100000:1.0:1784045569.687594:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873935360 00000100:00100000:1.0:1784045569.687637:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873935488 00000100:00100000:1.0:1784045569.687640:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873935488 00000100:00100000:1.0:1784045569.687656:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784045569.687664:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873935360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784045569.687697:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784045569.687745:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873935360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (2805us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045569.687753:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784045569.687776:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784045569.687782:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873935488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045569.687799:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784045569.687828:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873935488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045569.687834:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784045569.687876:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873935488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045569.687910:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873935360:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784045570.069833:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045570.203065:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873935616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045570.203134:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045570.203236:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873935616 00000100:00100000:0.0:1784045570.203243:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873935616 00000100:00100000:0.0:1784045570.203308:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045570.203332:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873935616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784045570.203353:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1784045570.207701:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873935616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4376us (4558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045570.207716:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1784045570.207757:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045570.213226:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873935616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784045571.092632:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.117912:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784045572.705195:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1784045572.759619:0:18435:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784045572.759628:0:18435:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784045572.759631:0:18435:0:(import.c:65:import_set_state_nolock()) ffff939cb5a99000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784045572.759643:0:18435:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff939cb5a99000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1784045572.759668:0:18435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b836d1180 x1870706873936128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784045572.759704:0:18435:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784045572.759707:0:18435:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784045572.759709:0:18435:0:(import.c:65:import_set_state_nolock()) ffff939cb59c2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784045572.759713:0:18435:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff939cb59c2000 using connection 192.168.203.144@tcp/0@lo 00000100:00100000:1.0:1784045572.759723:0:18435:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff939b8237aa00 x1870706873936640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784045572.759797:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873935744:0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.759864:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.759909:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873936384:0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.759934:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.759952:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873937024:0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.759977:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.760006:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784045572.760013:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873935872:0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760030:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.760044:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c91563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873936512:0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760063:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.760110:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873937152:0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760136:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.760163:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873936000:0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760185:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.760201:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873936768:0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760219:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.760235:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873937280:0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760257:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.760274:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784045572.760279:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873936256:0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760297:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.760319:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873936896:0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760341:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.760366:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873936384 00000100:00100000:1.0:1784045572.760373:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873936384 00000100:00100000:1.0:1784045572.760418:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873935872 00000100:00100000:1.0:1784045572.760421:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873935872 00000100:00100000:1.0:1784045572.760438:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784045572.760468:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873936384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760522:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873936384:12345-0@lo:400:kworker.0 Request processed in 77us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045572.760529:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784045572.760552:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784045572.760558:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873935872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760585:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873935872:12345-0@lo:400:kworker.0 Request processed in 27us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045572.760600:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784045572.760623:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873937024 00000100:00100000:1.0:1784045572.760627:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873937024 00000100:00100000:1.0:1784045572.760654:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873937152 00000100:00100000:1.0:1784045572.760658:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873937152 00000100:00100000:1.0:1784045572.760668:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873936768 00000100:00100000:1.0:1784045572.760671:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873936768 00000100:00100000:1.0:1784045572.760678:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873937280 00000100:00100000:1.0:1784045572.760680:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873937280 00000100:00100000:1.0:1784045572.760688:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873936256 00000100:00100000:1.0:1784045572.760690:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873936256 00000100:00100000:1.0:1784045572.760698:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873936896 00000100:00100000:1.0:1784045572.760700:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873936896 00000100:00100000:1.0:1784045572.760713:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784045572.760719:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873937024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760763:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1870706873937024:12345-0@lo:400:kworker.0 Request processed in 44us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045572.760769:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784045572.760782:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784045572.760788:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873937152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760815:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1870706873937152:12345-0@lo:400:kworker.0 Request processed in 27us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045572.760820:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784045572.760832:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784045572.760838:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873936768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760867:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873936768:12345-0@lo:400:kworker.0 Request processed in 30us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045572.760873:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784045572.760894:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784045572.760899:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873937280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760926:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873937280:12345-0@lo:400:kworker.0 Request processed in 27us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045572.760932:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784045572.760942:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784045572.760947:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873936256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.760969:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873936256:12345-0@lo:400:kworker.0 Request processed in 22us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045572.760974:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784045572.760984:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784045572.760990:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873936896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.761013:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873936896:12345-0@lo:400:kworker.0 Request processed in 24us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045572.761018:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1784045572.761051:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b836d0000 x1870706873936256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045572.761063:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873936256:0@lo:400:kworker.0 00010000:00080000:1.0:1784045572.761073:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b8237a680 x1870706873936896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045572.761081:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873936896:0@lo:400:kworker.0 00010000:00080000:1.0:1784045572.761089:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82379180 x1870706873936768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045572.761097:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873936768:0@lo:400:kworker.0 00010000:00080000:1.0:1784045572.761116:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82379c00 x1870706873937280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045572.761123:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873937280:0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.761155:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873935872:0@lo:400:kworker.0 00010000:00080000:1.0:1784045572.761165:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82378a80 x1870706873937152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045572.761173:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1870706873937152:0@lo:400:kworker.0 00000100:00100000:1.0:1784045572.761181:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873936384:0@lo:400:kworker.0 00010000:00080000:1.0:1784045572.761191:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82379f80 x1870706873937024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045572.761198:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1870706873937024:0@lo:400:kworker.0 00000100:00100000:0.0:1784045572.761296:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873936128:0@lo:8:kworker.0 00000100:00100000:0.0:1784045572.761337:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045572.761369:0:3622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873936640:0@lo:8:kworker.0 00000100:00100000:0.0:1784045572.761390:0:3622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045572.761429:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873935744 00000100:00100000:0.0:1784045572.761433:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873935744 00000100:00100000:0.0:1784045572.761490:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784045572.761496:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+24:3623:x1870706873935744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045572.761532:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+24:3623:x1870706873935744:12345-0@lo:400:kworker.0 Request processed in 36us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045572.761539:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784045572.761569:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873936512 00000100:00100000:0.0:1784045572.761578:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873936512 00000100:00100000:0.0:1784045572.761599:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873936000 00000100:00100000:0.0:1784045572.761602:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873936000 00000100:00100000:0.0:1784045572.761611:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873936128 00000100:00100000:0.0:1784045572.761613:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873936128 00000100:00100000:0.0:1784045572.761621:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873936640 00000100:00100000:0.0:1784045572.761623:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873936640 00000100:00100000:0.0:1784045572.761632:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045572.761637:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873936512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045572.761666:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873936512:12345-0@lo:400:kworker.0 Request processed in 29us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045572.761672:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784045572.761683:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045572.761688:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873936000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045572.761716:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873936000:12345-0@lo:400:kworker.0 Request processed in 28us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045572.761722:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784045572.761732:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784045572.761736:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1870706873936128:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1784045572.761761:0:18681:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:0.0:1784045572.761787:0:18681:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5475624df454dafe 00002000:00100000:0.0:1784045572.761800:0:18681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff939b83632800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784045572.761804:0:18681:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784045572.761807:0:18681:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784045572.761971:0:18681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784045572.761992:0:18681:0:(import.c:65:import_set_state_nolock()) ffff939b83630000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045572.762028:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1870706873936128:12345-0@lo:8:kworker.0 Request processed in 290us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045572.762039:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784045572.762052:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784045572.762056:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3622:x1870706873936640:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1784045572.762069:0:18681:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:0.0:1784045572.762083:0:18681:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5475624df454db05 00002000:00100000:0.0:1784045572.762089:0:18681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff939b83635800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1784045572.762092:0:18681:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1784045572.762094:0:18681:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784045572.762117:0:18681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1784045572.762128:0:18681:0:(import.c:65:import_set_state_nolock()) ffff939b83637800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045572.762157:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3622:x1870706873936640:12345-0@lo:8:kworker.0 Request processed in 99us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045572.762163:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1784045572.762197:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045572.762202:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045572.762203:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1784045572.762226:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b836d1180 x1870706873936128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784045597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784045572.762239:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784045572.762246:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784045572.762251:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784045572.762254:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb5a99000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784045572.762269:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784045572.762274:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1870706873936128:0@lo:8:kworker.0 00010000:00080000:0.0:1784045572.762286:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b8237aa00 x1870706873936640/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784045597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784045572.762319:0:3622:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1784045572.762325:0:3622:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784045572.762328:0:3622:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784045572.762330:0:3622:0:(import.c:65:import_set_state_nolock()) ffff939cb59c2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784045572.762340:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784045572.762344:0:3622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1870706873936640:0@lo:8:kworker.0 00000004:00080000:0.0:1784045572.762367:0:17916:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784045572.762429:0:17916:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 528870984380ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784045572.762436:0:17916:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1784045572.762494:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873936000:0@lo:400:kworker.0 00000100:00100000:0.0:1784045572.762520:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c91563100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873936512:0@lo:400:kworker.0 00000100:00100000:0.0:1784045572.762529:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873935744:0@lo:400:kworker.0 00000004:00080000:1.0:1784045572.763473:0:17198:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784045572.763540:0:17198:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 528872094530ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784045572.763546:0:17198:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1784045572.763600:0:17917:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1784045572.763623:0:17917:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82378a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17917:1870706873937536:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1784045572.763669:0:17917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.763692:0:17917:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cbf6530c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784045572.763839:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045572.763851:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873937408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045572.763878:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.763906:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873937536 00000100:00100000:1.0:1784045572.763912:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873937536 00000100:00100000:1.0:1784045572.763963:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784045572.763972:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17917:x1870706873937536:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1784045572.765704:0:17905:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1784045572.765843:0:17199:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1784045572.765869:0:17199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17199:1870706873937792:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784045572.765925:0:17199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045572.765952:0:17199:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b8307a240 going to sleep for 11 seconds 00000100:00100000:3.0:1784045572.765966:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784045572.765979:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873937664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045572.766002:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045572.766038:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873937408 00000100:00100000:3.0:1784045572.766044:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873937408 00000100:00100000:3.0:1784045572.766073:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873937664 00000100:00100000:3.0:1784045572.766076:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873937664 00000100:00100000:1.0:1784045572.766379:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045572.766390:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3625:x1870706873937408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784045572.766418:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784045572.766481:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3625:x1870706873937408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (2601us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045572.766488:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784045572.766506:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784045572.766512:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873937664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045572.766521:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784045572.766550:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873937664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045572.766555:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1784045572.766577:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045572.766590:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873937792 00000100:00100000:1.0:1784045572.766593:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873937792 00000100:00100000:1.0:1784045572.766618:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784045572.766624:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17199:x1870706873937792:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:1.0:1784045572.766702:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82379f80 x1870706873937408/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045572.766721:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873937408:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1784045572.766820:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b841c4380 x1870706873937664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784045588 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045572.766842:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873937664:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1784045572.776412:0:18681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1784045572.776421:0:18681:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1784045572.776664:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17917:x1870706873937536:12345-0@lo:7:osp-pre-1-1.0 Request processed in 12689us (12989us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045572.776676:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1784045572.776737:0:17917:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82378a80 x1870706873937536/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784045588 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045572.776751:0:17917:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82378a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17917:1870706873937536:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1784045572.776764:0:17917:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1784045572.776801:0:17917:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17917:1870706873937920:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1784045572.776835:0:17917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045572.776859:0:17917:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c87338240 going to sleep for 11 seconds 00000004:00080000:3.0:1784045572.776892:0:17152:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1784045572.777287:0:19104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873937920 00000100:00100000:1.0:1784045572.777294:0:19104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873937920 00000100:00100000:1.0:1784045572.777350:0:19104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784045572.777360:0:19104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17917:x1870706873937920:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1784045572.777392:0:19104:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1784045572.777428:0:19104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17917:x1870706873937920:12345-0@lo:5:osp-pre-1-1.0 Request processed in 70us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045572.777434:0:19104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00002000:00080000:1.0:1784045572.777489:0:18682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1784045572.777494:0:18682:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1784045572.777498:0:18682:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00010000:00080000:2.0:1784045572.778492:0:17917:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82880380 x1870706873937920/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784045588 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045572.778524:0:17917:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17917:1870706873937920:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1784045572.778536:0:17917:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1784045572.778577:0:17917:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17917:1870706873938048:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1784045572.778702:0:17917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045572.778730:0:17917:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c87338240 going to sleep for 11 seconds 00000100:00100000:2.0:1784045572.778746:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873938048 00000100:00100000:2.0:1784045572.778754:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873938048 00000100:00100000:3.0:1784045572.778982:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784045572.778991:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17917:x1870706873938048:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1784045572.779025:0:18681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:1.0:1784045572.801902:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784045572.801916:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034533e33/0x5475624df454db0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.801932:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1784045572.801937:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045572.801945:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034533e33/0x5475624df454db0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.801963:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034533e33/0x5475624df454db0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.801973:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034533e33/0x5475624df454db0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.801980:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034533e33/0x5475624df454db0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.802003:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045572.802019:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045572.802036:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034533e33/0x5475624df454db0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.802043:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cc600 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045572.802047:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034533e33/0x5475624df454db0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.802056:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034533e33/0x5475624df454db0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.802072:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034533e33/0x5475624df454db0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.802079:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034533e33/0x5475624df454db0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.802096:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045572.802098:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045572.802100:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784045572.806036:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784045572.806050:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5644919/0x5475624df454db13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.806069:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.806074:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.806080:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5644919/0x5475624df454db13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.806105:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5644919/0x5475624df454db13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.806116:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5644919/0x5475624df454db13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.806123:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5644919/0x5475624df454db13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.806149:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045572.806187:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045572.806196:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5644919/0x5475624df454db13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.806205:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986e00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045572.806210:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5644919/0x5475624df454db13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.806231:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5644919/0x5475624df454db13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.806249:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5644919/0x5475624df454db13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.806268:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5644919/0x5475624df454db13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.806287:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045572.806289:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045572.806291:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784045572.806662:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784045572.806676:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454db1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.806686:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.806690:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.806694:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454db1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.806704:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454db1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.806712:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454db1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.806718:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454db1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.806730:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045572.807205:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045572.807212:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454db1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.807222:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986200 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045572.807226:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454db1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.807235:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454db1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.807248:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454db1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.807277:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d79ef06/0x5475624df454db1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.807294:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045572.807297:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045572.807298:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784045572.808056:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784045572.808065:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b435cdf/0x5475624df454db21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.808078:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.808082:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.808098:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b435cdf/0x5475624df454db21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.808110:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b435cdf/0x5475624df454db21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.808126:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b435cdf/0x5475624df454db21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.808134:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b435cdf/0x5475624df454db21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.808155:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784045572.808765:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784045572.808772:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454db28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.808782:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.808784:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.808789:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454db28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.808798:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454db28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.808806:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454db28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.808814:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454db28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.808825:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045572.808835:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b435cdf/0x5475624df454db21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.808845:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987400 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.808849:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784045572.808850:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b435cdf/0x5475624df454db21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.808861:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784045572.808861:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b435cdf/0x5475624df454db21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.808880:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b435cdf/0x5475624df454db21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.808887:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b435cdf/0x5475624df454db21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045572.808907:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045572.808910:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045572.808912:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784045572.809350:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784045572.809356:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454db2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809377:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.809380:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.809385:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454db2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809396:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454db2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809403:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454db2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809409:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454db2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809428:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045572.809593:0:19790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045572.809598:0:19790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454db2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809604:0:19790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987e00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.809613:0:19790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454db2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809620:0:19790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454db2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809632:0:19790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454db2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809638:0:19790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454db2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809656:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454db28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809662:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.809665:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454db28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809672:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454db28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809681:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454db28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809688:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454db28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.809712:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.809714:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.809716:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.809721:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.809722:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.809724:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045572.809995:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784045572.810743:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784045572.810751:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b70ef872/0x5475624df454db36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.810765:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1784045572.810770:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045572.810775:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b70ef872/0x5475624df454db36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.810789:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b70ef872/0x5475624df454db36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.810811:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b70ef872/0x5475624df454db36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.810818:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b70ef872/0x5475624df454db36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.810864:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045572.811408:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045572.811417:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b70ef872/0x5475624df454db36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.811427:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fc200 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.811432:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b70ef872/0x5475624df454db36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.811441:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b70ef872/0x5475624df454db36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.811480:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b70ef872/0x5475624df454db36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.811488:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b70ef872/0x5475624df454db36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.811509:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.811510:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.811512:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784045572.811751:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784045572.811758:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454db3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.811767:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.811771:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.811776:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454db3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.811787:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454db3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.811796:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454db3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.811803:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454db3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.811826:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784045572.812418:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784045572.812425:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fab8182/0x5475624df454db44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.812433:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.812437:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.812441:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fab8182/0x5475624df454db44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.812493:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fab8182/0x5475624df454db44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.812503:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fab8182/0x5475624df454db44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.812510:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fab8182/0x5475624df454db44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.812524:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784045572.812533:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784045572.812538:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454db3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.812545:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986c00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.812550:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454db3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.812558:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454db3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.812679:0:19790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045572.812686:0:19790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fab8182/0x5475624df454db44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.812694:0:19790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987c00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:0.0:1784045572.812698:0:19790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fab8182/0x5475624df454db44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.812707:0:19790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fab8182/0x5475624df454db44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.812721:0:19790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fab8182/0x5475624df454db44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.812730:0:19790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fab8182/0x5475624df454db44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.812750:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045572.812758:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045572.812760:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.815392:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454db3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.815404:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454db3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.815460:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.815463:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.815466:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784045572.817029:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784045572.817040:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454db4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.817055:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.817060:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.817067:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454db4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.817080:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454db4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.817101:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454db4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.817110:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454db4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.817409:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784045572.818047:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784045572.818055:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.818078:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.818082:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.818087:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.818107:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.818116:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.818123:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.819774:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784045572.819788:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454db4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.819801:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987200 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:0.0:1784045572.819807:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454db4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.819818:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454db4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.819838:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454db4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.819846:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e29d171/0x5475624df454db4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.819871:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784045572.819875:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.819882:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987600 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:0.0:1784045572.819885:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.819905:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db52 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.819917:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db52 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.819925:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045572.819926:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784045572.819928:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.820066:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784045572.820074:0:18682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045572.820727:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784045572.822985:0:19497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1784045572.823012:0:19497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1784045572.823017:0:19497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784045572.830942:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17917:x1870706873938048:12345-0@lo:5:osp-pre-1-1.0 Request processed in 51945us (52233us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1784045572.830955:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784045572.831069:0:17917:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1784045572.831079:0:17917:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82880380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17917:1870706873938048:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1784045572.831097:0:17917:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1784045572.831379:0:17917:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17917:1870706873938176:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1784045572.831418:0:17917:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045572.831564:0:17917:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c921df780 going to sleep for 11 seconds 00000100:00100000:1.0:1784045572.831589:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873938176 00000100:00100000:1.0:1784045572.831595:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873938176 00000100:00100000:1.0:1784045572.831634:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784045572.831642:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17917:x1870706873938176:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1784045572.831688:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17917:x1870706873938176:12345-0@lo:900:osp-pre-1-1.0 Request processed in 47us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045572.831695:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784045572.831732:0:17917:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b82379f80 x1870706873938176/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1784045588 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045572.831743:0:17917:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17917:1870706873938176:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1784045572.834675:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045572.834688:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfe18b54/0x5475624df454db59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.834705:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1784045572.834710:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045572.834715:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe18b54/0x5475624df454db59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.834732:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfe18b54/0x5475624df454db59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.834742:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfe18b54/0x5475624df454db59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.834749:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfe18b54/0x5475624df454db59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.834777:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045572.835659:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045572.835668:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfe18b54/0x5475624df454db59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.835678:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031a00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045572.835682:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfe18b54/0x5475624df454db59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.835697:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfe18b54/0x5475624df454db59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.835715:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfe18b54/0x5475624df454db59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.835723:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfe18b54/0x5475624df454db59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.835744:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.835746:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.835748:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045572.835817:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045572.835823:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c401bc1/0x5475624df454db60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.835837:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1784045572.835850:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045572.835856:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c401bc1/0x5475624df454db60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.835866:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c401bc1/0x5475624df454db60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.835874:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c401bc1/0x5475624df454db60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.835881:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c401bc1/0x5475624df454db60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.835907:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045572.836505:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045572.836513:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c401bc1/0x5475624df454db60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.836523:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030a00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.836527:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c401bc1/0x5475624df454db60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.836551:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c401bc1/0x5475624df454db60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.836577:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c401bc1/0x5475624df454db60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.836586:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c401bc1/0x5475624df454db60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784045572.836588:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045572.836599:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f927ed05/0x5475624df454db67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.836611:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.836611:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.836614:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.836616:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.836618:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.836624:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f927ed05/0x5475624df454db67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.836637:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f927ed05/0x5475624df454db67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.836645:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f927ed05/0x5475624df454db67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.836659:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f927ed05/0x5475624df454db67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.836679:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045572.836696:0:19790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045572.836702:0:19790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f927ed05/0x5475624df454db67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.836711:0:19790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030c00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.836715:0:19790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f927ed05/0x5475624df454db67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.836724:0:19790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f927ed05/0x5475624df454db67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.836738:0:19790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f927ed05/0x5475624df454db67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.836759:0:19790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f927ed05/0x5475624df454db67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.836772:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.836774:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.836776:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045572.836966:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045572.836976:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000365d0683/0x5475624df454db6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.836985:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1784045572.836988:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045572.836992:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000365d0683/0x5475624df454db6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837000:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000365d0683/0x5475624df454db6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837007:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000365d0683/0x5475624df454db6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837014:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000365d0683/0x5475624df454db6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837034:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784045572.837368:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045572.837374:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d2c30a0/0x5475624df454db75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837387:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1784045572.837390:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045572.837394:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d2c30a0/0x5475624df454db75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837404:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d2c30a0/0x5475624df454db75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837412:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d2c30a0/0x5475624df454db75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837420:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d2c30a0/0x5475624df454db75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837437:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784045572.837447:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045572.837451:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000365d0683/0x5475624df454db6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837459:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030e00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045572.837462:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000365d0683/0x5475624df454db6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.837586:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045572.837592:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d2c30a0/0x5475624df454db75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.837600:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031e00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.837604:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d2c30a0/0x5475624df454db75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.837611:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d2c30a0/0x5475624df454db75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837620:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000365d0683/0x5475624df454db6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.837626:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d2c30a0/0x5475624df454db75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.837637:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d2c30a0/0x5475624df454db75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837658:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000365d0683/0x5475624df454db6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.837662:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.837665:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.837668:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.837671:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000365d0683/0x5475624df454db6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837689:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.837691:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.837693:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045572.837968:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045572.837974:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e918a6c5/0x5475624df454db7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.837983:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1784045572.837986:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045572.837991:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e918a6c5/0x5475624df454db7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.838000:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e918a6c5/0x5475624df454db7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.838008:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e918a6c5/0x5475624df454db7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.838015:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e918a6c5/0x5475624df454db7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.838048:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045572.838362:0:19790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045572.838367:0:19790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e918a6c5/0x5475624df454db7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.838374:0:19790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.838377:0:19790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e918a6c5/0x5475624df454db7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.838385:0:19790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e918a6c5/0x5475624df454db7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.838396:0:19790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e918a6c5/0x5475624df454db7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.838403:0:19790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e918a6c5/0x5475624df454db7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.838419:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.838420:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.838422:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045572.838691:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045572.838699:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd30cffc/0x5475624df454db83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.838710:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1784045572.838713:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045572.838718:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd30cffc/0x5475624df454db83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.838728:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd30cffc/0x5475624df454db83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.838737:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd30cffc/0x5475624df454db83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.838745:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd30cffc/0x5475624df454db83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.838762:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045572.839128:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045572.839134:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd30cffc/0x5475624df454db83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.839143:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031c00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.839147:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd30cffc/0x5475624df454db83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.839167:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd30cffc/0x5475624df454db83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.839178:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd30cffc/0x5475624df454db83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.839185:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd30cffc/0x5475624df454db83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.839199:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.839200:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.839202:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045572.839352:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045572.839358:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f369aef1/0x5475624df454db8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.839367:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1784045572.839376:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045572.839381:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f369aef1/0x5475624df454db8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.839391:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f369aef1/0x5475624df454db8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.839398:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f369aef1/0x5475624df454db8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.839406:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f369aef1/0x5475624df454db8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.839483:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784045572.839883:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045572.839890:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004260d41a/0x5475624df454db91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.839909:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1784045572.839912:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045572.839917:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004260d41a/0x5475624df454db91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.839927:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004260d41a/0x5475624df454db91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.839935:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004260d41a/0x5475624df454db91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.839947:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004260d41a/0x5475624df454db91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840047:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784045572.840052:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f369aef1/0x5475624df454db8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840059:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.840063:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f369aef1/0x5475624df454db8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840070:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f369aef1/0x5475624df454db8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840082:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f369aef1/0x5475624df454db8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840100:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f369aef1/0x5475624df454db8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840116:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045572.840119:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004260d41a/0x5475624df454db91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840126:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b2000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.840129:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004260d41a/0x5475624df454db91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840137:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004260d41a/0x5475624df454db91 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840148:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004260d41a/0x5475624df454db91 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840154:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.840156:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.840158:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.840220:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784045572.840226:0:18682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004260d41a/0x5475624df454db91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784045572.840753:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045572.840760:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454db98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.840771:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1784045572.840774:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045572.840780:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454db98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.840789:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454db98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.840798:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454db98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.840805:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454db98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840859:0:19790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045572.840864:0:19790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454db98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840871:0:19790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106ea00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.840880:0:19790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454db98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840888:0:19790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454db98 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.840949:0:19790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454db98 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.841034:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784045572.841039:0:18682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454db98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.841163:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.841165:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.841368:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.841460:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784045572.843898:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784045572.843916:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.843932:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.843937:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.843943:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.843957:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.843967:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.843975:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.844010:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045572.844073:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045572.844081:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.844091:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987600 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045572.844096:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.844105:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.844127:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.844135:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a73f5c94/0x5475624df454db9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.844159:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.844168:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.844170:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784045572.844775:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784045572.844783:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454dba6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.844793:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.844798:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.844803:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454dba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.844814:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454dba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.844822:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454dba6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.844830:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454dba6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.844857:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784045572.844992:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045572.844997:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454dba6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.845005:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986c00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045572.845009:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454dba6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.845018:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454dba6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.845030:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454dba6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.845038:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abc78778/0x5475624df454dba6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.845052:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.845054:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.845056:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784045572.845374:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784045572.845380:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454dbad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.845389:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.845399:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.845404:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454dbad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.845415:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454dbad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.845423:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454dbad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.845431:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454dbad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.846425:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784045572.847632:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784045572.847643:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454dbb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.847660:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1784045572.847664:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045572.847670:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454dbb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.847683:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454dbb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.847692:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454dbb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.847706:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454dbb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.853573:0:19790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784045572.853587:0:19790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454dbad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.853600:0:19790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987000 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045572.853605:0:19790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454dbad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.853633:0:19790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454dbad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.853656:0:19790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454dbad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.853663:0:19790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ca9a801/0x5475624df454dbad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.853688:0:19790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784045572.853691:0:19790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454dbb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.853697:0:19790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987e00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:3.0:1784045572.853701:0:19790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454dbb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.853708:0:19790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454dbb4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.853717:0:19790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454dbb4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.853725:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.853727:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045572.853735:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.854019:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784045572.854027:0:18682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0e810b4/0x5475624df454dbb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.854097:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045572.861355:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045572.861370:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454dbbb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.861388:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1784045572.861393:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045572.861401:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454dbbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.861416:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454dbbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.861426:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454dbbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.861435:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454dbbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.861485:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784045572.862117:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045572.862126:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454dbbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.862137:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106ea00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.862142:0:17160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454dbbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.862153:0:17160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454dbbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.862172:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454dbbb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.862180:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa5848c9/0x5475624df454dbbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.862199:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.862206:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.862208:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784045572.862859:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045572.862868:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f460caf/0x5475624df454dbc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.862881:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1784045572.862886:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045572.862892:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f460caf/0x5475624df454dbc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.862922:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f460caf/0x5475624df454dbc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.862933:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f460caf/0x5475624df454dbc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.862941:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f460caf/0x5475624df454dbc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.862962:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784045572.863739:0:18682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784045572.863746:0:18682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc2cb7f2/0x5475624df454dbc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.863757:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1784045572.863761:0:18682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045572.863766:0:18682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc2cb7f2/0x5475624df454dbc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.863776:0:18682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc2cb7f2/0x5475624df454dbc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.863783:0:18682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc2cb7f2/0x5475624df454dbc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.863801:0:18682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc2cb7f2/0x5475624df454dbc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045572.863820:0:18682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1784045572.863861:0:18682:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1784045572.864221:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17199:x1870706873937792:12345-0@lo:5:osp-pre-1-0.0 Request processed in 97593us (98291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045572.864231:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784045572.864297:0:17199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17199:1870706873937792:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1784045572.864325:0:17199:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1784045572.864378:0:17199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17199:1870706873938304:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784045572.864411:0:17199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045572.864437:0:17199:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c9770c000 going to sleep for 11 seconds 00000100:00100000:3.0:1784045572.864488:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873938304 00000100:00100000:3.0:1784045572.864495:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873938304 00010000:00010000:2.0:1784045572.864510:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784045572.864519:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f460caf/0x5475624df454dbc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.864530:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106e600 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.864535:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f460caf/0x5475624df454dbc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045572.864539:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1784045572.864550:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f460caf/0x5475624df454dbc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045572.864552:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17199:x1870706873938304:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1784045572.864574:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f460caf/0x5475624df454dbc2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.864580:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f460caf/0x5475624df454dbc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784045572.864605:0:18683:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1784045572.864613:0:17161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045572.864619:0:17161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc2cb7f2/0x5475624df454dbc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.864625:0:17161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106f200 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045572.864628:0:17161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc2cb7f2/0x5475624df454dbc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.864649:0:17161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc2cb7f2/0x5475624df454dbc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.864659:0:17161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc2cb7f2/0x5475624df454dbc9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.864665:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc2cb7f2/0x5475624df454dbc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045572.864680:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.864681:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045572.864687:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784045572.865173:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045572.871573:0:17199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17199:1870706873938304:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784045572.871595:0:17199:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:3.0:1784045572.871868:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17199:x1870706873938304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6915us (7053us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1784045572.871880:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1784045573.139676:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784045573.945351:0:19854:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg344-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784045574.163985:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045574.291635:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045574.291661:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cc13b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873938432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784045574.291732:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045574.292282:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873938432 00000100:00100000:3.0:1784045574.292290:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873938432 00000100:00100000:3.0:1784045574.292385:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784045574.292396:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873938432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784045574.292424:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784045574.292495:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873938432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045574.292503:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784045574.292547:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cc13b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873938432:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784045574.292608:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:1.0:1784045574.548439:0:19906:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784045574.548977:0:19906:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784045574.803854:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873938688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045574.803927:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045574.804013:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873938688 00000100:00100000:3.0:1784045574.804021:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873938688 00000100:00100000:3.0:1784045574.804090:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784045574.804099:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873938688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045574.804129:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784045574.804924:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873938688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 824us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045574.804934:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784045574.804988:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873938688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045574.805018:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045574.805026:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873938560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045574.805064:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045574.805221:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873938560 00000100:00100000:1.0:1784045574.805227:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873938560 00000100:00100000:1.0:1784045574.805257:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784045574.805265:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873938560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045574.805311:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784045574.805431:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873938560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 167us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045574.805439:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784045574.806128:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873938560:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784045575.187675:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784045575.262719:0:19956:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784045575.262949:0:19956:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784045575.318629:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873938816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784045575.318696:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045575.318751:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873938816 00000100:00100000:3.0:1784045575.318758:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873938816 00000100:00100000:3.0:1784045575.318812:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784045575.318821:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873938816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045575.318840:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784045575.318881:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873938816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045575.318888:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1784045575.318909:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045575.319087:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873938816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045575.424572:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045575.424776:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863361280 00000100:00100000:1.0:1784045575.424786:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863361280 00000100:00100000:1.0:1784045575.424836:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 115 00000100:00100000:1.0:1784045575.424844:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2393:x1870706863361280:12345-192.168.203.44@tcp:250:mount.lustre.0 00010000:00080000:1.0:1784045575.424872:0:17167:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e0f86ebe-963e-4824-a274-0f8b57132670@192.168.203.44@tcp t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:1.0:1784045575.424900:0:17167:0:(genops.c:1406:class_connect()) connect: client e0f86ebe-963e-4824-a274-0f8b57132670, cookie 0x5475624df454dbd0 00000100:00080000:1.0:1784045575.427846:0:17167:0:(import.c:65:import_set_state_nolock()) ffff939cb6595000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784045575.427937:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+5:2393:x1870706863361280:12345-192.168.203.44@tcp:250:mount.lustre.0 Request processed in 3088us (3368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045575.428021:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 115 00000100:00100000:1.0:1784045575.430178:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045575.430253:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863361408 00000100:00100000:0.0:1784045575.430262:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863361408 00000100:00100000:0.0:1784045575.430325:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 116 00000100:00100000:0.0:1784045575.430405:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+5:14903:x1870706863361408:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784045575.430422:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045575.430439:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc21fc200/0x5475624df454dbd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73f282 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045575.430497:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc21fc200/0x5475624df454dbd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f282 expref: 6 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045575.430524:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc21fc200/0x5475624df454dbd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f282 expref: 6 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045575.430534:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fc200, rc 0) 00000100:00100000:0.0:1784045575.430584:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+6:14903:x1870706863361408:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 184us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045575.430591:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 116 00000100:00100000:2.0:1784045575.439221:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045575.439414:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863361536 00000100:00100000:1.0:1784045575.439423:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863361536 00000100:00100000:1.0:1784045575.439569:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 117 00000100:00100000:1.0:1784045575.439578:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+6:14903:x1870706863361536:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784045575.439694:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+6:14903:x1870706863361536:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 117us (479us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784045575.439701:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 117 00000100:00100000:1.0:1784045575.443800:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045575.444874:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863361664 00000100:00100000:2.0:1784045575.444887:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863361664 00000100:00100000:2.0:1784045575.444956:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 118 00000100:00100000:2.0:1784045575.444966:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+6:14903:x1870706863361664:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784045575.444986:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045575.445003:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81986400/0x5475624df454dbde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73f289 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045575.445030:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986400/0x5475624df454dbde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f289 expref: 7 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045575.445040:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81986400/0x5475624df454dbde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f289 expref: 7 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045575.445049:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986400, rc 0) 00000100:00100000:2.0:1784045575.445103:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+7:14903:x1870706863361664:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 138us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045575.445111:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 118 00000100:00100000:0.0:1784045575.449410:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045575.449507:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863361792 00000100:00100000:1.0:1784045575.449517:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863361792 00000100:00100000:1.0:1784045575.449585:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 119 00000100:00100000:1.0:1784045575.449596:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+7:14903:x1870706863361792:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784045575.449760:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+8:14903:x1870706863361792:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 165us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045575.449768:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 119 00000100:00100000:1.0:1784045575.452000:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045575.452066:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863361920 00000100:00100000:0.0:1784045575.452074:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863361920 00000100:00100000:0.0:1784045575.452130:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 120 00000100:00100000:0.0:1784045575.452140:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+8:14903:x1870706863361920:12345-192.168.203.44@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784045575.452279:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+8:14903:x1870706863361920:12345-192.168.203.44@tcp:503:mount.lustre.0 Request processed in 140us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045575.452298:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 120 00000100:00100000:3.0:1784045575.458646:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045575.458838:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863362048 00000100:00100000:0.0:1784045575.458848:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863362048 00000100:00100000:0.0:1784045575.458909:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 121 00000100:00100000:0.0:1784045575.458922:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+8:14921:x1870706863362048:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784045575.459319:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+8:14921:x1870706863362048:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 399us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045575.459326:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 121 00000100:00100000:2.0:1784045575.488020:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045575.488615:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863362176 00000100:00100000:1.0:1784045575.488624:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863362176 00000100:00100000:1.0:1784045575.488675:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 122 00000100:00100000:1.0:1784045575.488683:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+8:14921:x1870706863362176:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784045575.488837:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+8:14921:x1870706863362176:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 154us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045575.488845:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 122 00000100:00100000:1.0:1784045575.497633:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045575.497942:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863362304 00000100:00100000:0.0:1784045575.497951:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863362304 00000100:00100000:0.0:1784045575.498006:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 123 00000100:00100000:0.0:1784045575.498027:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+8:14921:x1870706863362304:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784045575.498227:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+8:14921:x1870706863362304:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 200us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045575.498236:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 123 00000100:00100000:3.0:1784045575.503045:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045575.506151:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863362432 00000100:00100000:2.0:1784045575.506165:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863362432 00000100:00100000:2.0:1784045575.506240:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 124 00000100:00100000:2.0:1784045575.506250:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+8:14903:x1870706863362432:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784045575.506264:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045575.506281:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81987000/0x5475624df454dbe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73f2ba expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045575.506402:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987000/0x5475624df454dbe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f2ba expref: 9 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045575.506414:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81987000/0x5475624df454dbe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f2ba expref: 9 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045575.506423:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987000, rc 0) 00000100:00100000:2.0:1784045575.506542:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+9:14903:x1870706863362432:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 294us (3506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045575.506550:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 124 00000100:00100000:2.0:1784045575.521003:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045575.521131:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863362560 00000100:00100000:0.0:1784045575.521141:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863362560 00000100:00100000:0.0:1784045575.521202:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 125 00000100:00100000:0.0:1784045575.521211:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+9:14903:x1870706863362560:12345-192.168.203.44@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784045575.521241:0:17166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784045575.521268:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784045575.521272:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784045575.521276:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784045575.521278:0:17166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1784045575.521281:0:17166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1784045575.523389:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+9:14903:x1870706863362560:12345-192.168.203.44@tcp:256:mount.lustre.0 Request processed in 2114us (2331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045575.523405:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 125 00000100:00100000:3.0:1784045575.539845:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045575.540147:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863362688 00000100:00100000:1.0:1784045575.540156:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863362688 00000100:00100000:1.0:1784045575.540281:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 126 00000100:00100000:1.0:1784045575.540302:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+9:14903:x1870706863362688:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784045575.540318:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045575.540336:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b836cc600/0x5475624df454dbec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73f2c1 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045575.540364:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b836cc600/0x5475624df454dbec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f2c1 expref: 10 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045575.540375:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b836cc600/0x5475624df454dbec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f2c1 expref: 10 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045575.540400:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836cc600, rc 0) 00000100:00100000:1.0:1784045575.540488:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+10:14903:x1870706863362688:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 188us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045575.540495:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 126 00000100:00100000:2.0:1784045575.542571:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045575.542702:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863362816 00000100:00100000:0.0:1784045575.542710:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863362816 00000100:00100000:0.0:1784045575.542761:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 127 00000100:00100000:0.0:1784045575.542770:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+10:14903:x1870706863362816:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784045575.542932:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+10:14903:x1870706863362816:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 162us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045575.542940:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 127 00000100:00100000:3.0:1784045575.547663:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045575.547859:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863362944 00000100:00100000:1.0:1784045575.547870:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863362944 00000100:00100000:1.0:1784045575.547927:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 128 00000100:00100000:1.0:1784045575.547936:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+10:14903:x1870706863362944:12345-192.168.203.44@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784045575.548526:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+10:14903:x1870706863362944:12345-192.168.203.44@tcp:503:mount.lustre.0 Request processed in 590us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045575.548534:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 128 00000100:00100000:3.0:1784045575.555389:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045575.555752:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863363072 00000100:00100000:0.0:1784045575.555761:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863363072 00000100:00100000:0.0:1784045575.555846:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 129 00000100:00100000:0.0:1784045575.555857:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+10:14926:x1870706863363072:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784045575.556030:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+10:14926:x1870706863363072:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 173us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045575.556038:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 129 00000100:00100000:3.0:1784045575.566299:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045575.566421:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863363200 00000100:00100000:2.0:1784045575.566431:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863363200 00000100:00100000:2.0:1784045575.566529:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 130 00000100:00100000:2.0:1784045575.566539:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+10:14926:x1870706863363200:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045575.566703:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+10:14926:x1870706863363200:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 166us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045575.566712:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 130 00000100:00100000:3.0:1784045575.576374:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045575.576503:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045575.576845:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863363328 00000100:00100000:0.0:1784045575.576855:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863363328 00000100:00100000:0.0:1784045575.576906:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863363584 00000100:00100000:0.0:1784045575.576910:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863363584 00000100:00100000:0.0:1784045575.576933:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:0.0:1784045575.576941:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1870706863363328:12345-192.168.203.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784045575.576986:0:17172:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 5c4ec1df-89f5-44e3-9b84-9820a7989c32@192.168.203.44@tcp t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:0.0:1784045575.577040:0:17172:0:(genops.c:1406:class_connect()) connect: client 5c4ec1df-89f5-44e3-9b84-9820a7989c32, cookie 0x5475624df454dbf3 00000004:00100000:0.0:1784045575.577064:0:17172:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1784045575.577272:0:17172:0:(import.c:65:import_set_state_nolock()) ffff939b83633000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045575.577363:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2393:x1870706863363328:12345-192.168.203.44@tcp:38:mount.lustre.0 Request processed in 420us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045575.577371:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:0.0:1784045575.577390:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:0.0:1784045575.577395:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1870706863363584:12345-192.168.203.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1784045575.577412:0:17172:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 5c4ec1df-89f5-44e3-9b84-9820a7989c32@192.168.203.44@tcp t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:0.0:1784045575.577476:0:17172:0:(genops.c:1406:class_connect()) connect: client 5c4ec1df-89f5-44e3-9b84-9820a7989c32, cookie 0x5475624df454dbfa 00000004:00100000:0.0:1784045575.577493:0:17172:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00100000:3.0:1784045575.581722:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045575.581819:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00080000:0.0:1784045575.582163:0:17172:0:(import.c:65:import_set_state_nolock()) ffff939b83636800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045575.582276:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2393:x1870706863363584:12345-192.168.203.44@tcp:38:mount.lustre.0 Request processed in 4876us (5770us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045575.582311:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:0.0:1784045575.593698:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863363840 00000100:00100000:0.0:1784045575.593713:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863363840 00000100:00080000:3.0:1784045575.593794:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784045575.594755:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863363456 00000100:00100000:1.0:1784045575.594763:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863363456 00000100:00100000:2.0:1784045575.595752:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:2.0:1784045575.595774:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:14903:x1870706863363840:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784045575.595815:0:17173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784045575.596394:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:14903:x1870706863363840:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 628us (14678us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045575.596404:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:2.0:1784045575.596462:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:2.0:1784045575.596471:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:0:x1870706863363456:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784045575.596487:0:17173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784045575.596513:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:0:x1870706863363456:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 44us (14695us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045575.596520:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:2.0:1784045575.596594:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045575.596642:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863363712 00000100:00100000:1.0:1784045575.596650:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863363712 00000100:00100000:1.0:1784045575.596699:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:1.0:1784045575.596709:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:0:x1870706863363712:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784045575.596728:0:18705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784045575.597666:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:0:x1870706863363712:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 955us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045575.597676:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00080000:3.0:1784045575.597746:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045575.605205:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045575.605344:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863363968 00000100:00100000:1.0:1784045575.605354:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863363968 00000100:00100000:1.0:1784045575.605417:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:1.0:1784045575.605427:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:14903:x1870706863363968:12345-192.168.203.44@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784045575.605577:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:14903:x1870706863363968:12345-192.168.203.44@tcp:40:mount.lustre.0 Request processed in 151us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045575.605585:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 12 00000100:00100000:3.0:1784045575.609612:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045575.609655:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045575.609709:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045575.609786:0:19104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863364096 00000100:00100000:2.0:1784045575.609796:0:19104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863364096 00000100:00100000:2.0:1784045575.609848:0:19104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863364224 00000100:00100000:2.0:1784045575.609852:0:19104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863364224 00000100:00100000:0.0:1784045575.609857:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:0.0:1784045575.609870:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1870706863364096:12345-192.168.203.44@tcp:8:mount.lustre.0 00000100:00100000:2.0:1784045575.609886:0:19104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:2.0:1784045575.609893:0:19104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1870706863364224:12345-192.168.203.44@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784045575.609905:0:18681:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 5c4ec1df-89f5-44e3-9b84-9820a7989c32@192.168.203.44@tcp t0 exp 0000000000000000 cur 531 last 0 00010000:00080000:2.0:1784045575.609924:0:19104:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 5c4ec1df-89f5-44e3-9b84-9820a7989c32@192.168.203.44@tcp t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:0.0:1784045575.609946:0:18681:0:(genops.c:1406:class_connect()) connect: client 5c4ec1df-89f5-44e3-9b84-9820a7989c32, cookie 0x5475624df454dc01 00002000:00100000:0.0:1784045575.609959:0:18681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5c4ec1df-89f5-44e3-9b84-9820a7989c32/ffff939b83634800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784045575.609969:0:18681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000020:00000080:2.0:1784045575.610131:0:19104:0:(genops.c:1406:class_connect()) connect: client 5c4ec1df-89f5-44e3-9b84-9820a7989c32, cookie 0x5475624df454dc08 00002000:00100000:2.0:1784045575.610139:0:19104:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5c4ec1df-89f5-44e3-9b84-9820a7989c32/ffff939cbb763800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784045575.610149:0:18681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00100000:2.0:1784045575.610154:0:19104:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1784045575.610181:0:18681:0:(import.c:65:import_set_state_nolock()) ffff939b83634000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045575.610260:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2393:x1870706863364096:12345-192.168.203.44@tcp:8:mount.lustre.0 Request processed in 389us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045575.610272:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00002000:00080000:2.0:1784045575.610303:0:19104:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784045575.610323:0:19104:0:(import.c:65:import_set_state_nolock()) ffff939cc1273800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784045575.610351:0:19104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2393:x1870706863364224:12345-192.168.203.44@tcp:8:mount.lustre.0 Request processed in 457us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045575.610359:0:19104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:1.0:1784045575.610424:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863364352 00000100:00100000:1.0:1784045575.610435:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863364352 00000100:00100000:1.0:1784045575.610505:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:1.0:1784045575.610514:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:14903:x1870706863364352:12345-192.168.203.44@tcp:900:mount.lustre.0 00000100:00100000:1.0:1784045575.610572:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:14903:x1870706863364352:12345-192.168.203.44@tcp:900:mount.lustre.0 Request processed in 59us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045575.610579:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:3.0:1784045575.614519:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045575.614759:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863364480 00000100:00100000:0.0:1784045575.614781:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863364480 00000100:00100000:0.0:1784045575.614839:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:0.0:1784045575.614850:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:14903:x1870706863364480:12345-192.168.203.44@tcp:33:mount.lustre.0 00000004:00080000:0.0:1784045575.624161:0:17175:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8337us 00000004:00200000:1.0:1784045575.643117:0:17175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1784045575.643249:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:14903:x1870706863364480:12345-192.168.203.44@tcp:33:mount.lustre.0 Request processed in 28396us (28733us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045575.643263:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00000040:00080000:1.0:1784045575.700213:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784045575.893025:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045575.893148:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863364608 00000100:00100000:1.0:1784045575.893157:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863364608 00000100:00100000:1.0:1784045575.893224:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:1.0:1784045575.893235:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:14949:x1870706863364608:12345-192.168.203.44@tcp:101:mkdir.0 00010000:00010000:1.0:1784045575.893254:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045575.893350:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454dc0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f2f2 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045575.893431:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836ccc00/0x5475624df454dc16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045575.893505:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b836ccc00/0x5475624df454dc16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045575.893520:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b836ccc00/0x5475624df454dc16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045575.893580:0:17173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784045575.893584:0:17173:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784045575.893619:0:17173:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b836ccc00/0x5475624df454dc16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045575.893645:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836cd000/0x5475624df454dc0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f2f2 expref: 8 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045575.893665:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b836ccc00/0x5475624df454dc16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f2f2 expref: 7 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045575.893673:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:1.0:1784045575.893675:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045575.893679:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b836ccc00, rc 0) 00000100:00100000:1.0:1784045575.893738:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:14949:x1870706863364608:12345-192.168.203.44@tcp:101:mkdir.0 Request processed in 505us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045575.893746:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 13 00010000:00010000:2.0:1784045576.211704:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045577.238767:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784045577.806859:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045577.810643:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863364736 00000100:00100000:2.0:1784045577.810686:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863364736 00000100:00100000:2.0:1784045577.810794:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:2.0:1784045577.810808:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:15001:x1870706863364736:12345-192.168.203.44@tcp:41:lfs.0 00000004:00000024:2.0:1784045577.810856:0:17174:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1784045577.810976:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:15001:x1870706863364736:12345-192.168.203.44@tcp:41:lfs.0 Request processed in 172us (4131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045577.810984:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00080000:3.0:1784045577.811061:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045577.820630:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045577.820750:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863364864 00000100:00100000:1.0:1784045577.820764:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863364864 00000100:00100000:1.0:1784045577.820855:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:1.0:1784045577.820866:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:15001:x1870706863364864:12345-192.168.203.44@tcp:41:lfs.0 00000004:00000024:1.0:1784045577.820923:0:17173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784045577.821059:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:15001:x1870706863364864:12345-192.168.203.44@tcp:41:lfs.0 Request processed in 194us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045577.821068:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00080000:3.0:1784045577.821824:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045577.823671:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045577.823759:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863364992 00000100:00100000:3.0:1784045577.823767:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863364992 00000100:00100000:3.0:1784045577.823883:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:3.0:1784045577.823893:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:15001:x1870706863364992:12345-192.168.203.44@tcp:13:lfs.0 00002000:00000024:3.0:1784045577.823923:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1784045577.823994:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045577.824049:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:15001:x1870706863364992:12345-192.168.203.44@tcp:13:lfs.0 Request processed in 156us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045577.824074:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:2.0:1784045577.828084:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045577.828197:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863365120 00000100:00100000:3.0:1784045577.828207:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863365120 00000100:00100000:3.0:1784045577.828312:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:3.0:1784045577.828322:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:15001:x1870706863365120:12345-192.168.203.44@tcp:13:lfs.0 00002000:00000024:3.0:1784045577.828355:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784045577.828515:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:15001:x1870706863365120:12345-192.168.203.44@tcp:13:lfs.0 Request processed in 193us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045577.828522:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00080000:0.0:1784045577.828593:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784045577.875696:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873938944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045577.875815:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045577.875884:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c25407c2-0928-423d-881e-1585e6e3cc3c:3624:1870706873939072:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.875910:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045577.875929:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873939584:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.875950:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045577.875965:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873940096:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.875979:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045577.876030:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873939072 00000100:00100000:1.0:1784045577.876039:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873939072 00000100:00100000:1.0:1784045577.876085:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784045577.876093:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+24:3624:x1870706873939072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.877566:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+24:3624:x1870706873939072:12345-0@lo:400:kworker.0 Request processed in 1466us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045577.877579:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784045577.877582:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873940608:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.877651:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045577.877691:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873939328:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.877697:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c25407c2-0928-423d-881e-1585e6e3cc3c:3624:1870706873939072:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.877719:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784045577.877726:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b83382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873939456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784045577.877728:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045577.877760:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873939840:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.877761:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045577.877790:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873939968:0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.877797:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045577.877820:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045577.877826:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873940352:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.877841:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873940480:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.877860:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045577.877887:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873939200:0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.877895:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045577.877917:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045577.877941:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873939712:0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.877943:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873939584 00000100:00100000:1.0:1784045577.877950:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873939584 00000100:00100000:0.0:1784045577.877961:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045577.877994:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873940096 00000100:00100000:1.0:1784045577.877998:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873940096 00000100:00100000:0.0:1784045577.877999:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873940224:0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.878017:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873939328 00000100:00100000:1.0:1784045577.878021:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873939328 00000100:00100000:0.0:1784045577.878026:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045577.878036:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873939968 00000100:00100000:1.0:1784045577.878040:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873939968 00000100:00100000:1.0:1784045577.878063:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045577.878071:0:19104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784045577.878072:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873939584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.878083:0:19104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873940096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.878119:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873939584:12345-0@lo:400:kworker.0 Request processed in 49us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045577.878131:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784045577.878140:0:19104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873940096:12345-0@lo:400:kworker.0 Request processed in 60us (2157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045577.878148:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784045577.878152:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873939328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.878178:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873939328:12345-0@lo:400:kworker.0 Request processed in 26us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045577.878218:0:18682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1784045577.878230:0:18682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1784045577.878246:0:18683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1784045577.878385:0:19104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784045577.878392:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784045577.878410:0:19104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784045577.878420:0:19104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873939968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.878434:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873939328:0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.878474:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873940608 00000100:00100000:1.0:1784045577.878477:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873940608 00000100:00100000:0.0:1784045577.878479:0:19104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873939968:12345-0@lo:400:kworker.0 Request processed in 60us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045577.878489:0:19104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784045577.878494:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873940480 00000100:00100000:1.0:1784045577.878497:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873940480 00000100:00100000:1.0:1784045577.878509:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873940352 00000100:00100000:1.0:1784045577.878510:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873940352 00000100:00100000:0.0:1784045577.878518:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873939840 00000100:00100000:1.0:1784045577.878520:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873939712 00000100:00100000:1.0:1784045577.878524:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873939712 00000100:00100000:0.0:1784045577.878524:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873939840 00000100:00100000:1.0:1784045577.878533:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873940224 00000100:00100000:1.0:1784045577.878535:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873940224 00000100:00100000:1.0:1784045577.878550:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784045577.878554:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873940608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.878563:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873939200 00000100:00100000:0.0:1784045577.878568:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873939200 00000100:00100000:0.0:1784045577.878583:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784045577.878589:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873939840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.878631:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873939840:12345-0@lo:400:kworker.0 Request processed in 42us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045577.878641:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873940608:12345-0@lo:400:kworker.0 Request processed in 84us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045577.878641:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784045577.878650:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784045577.878661:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784045577.878667:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784045577.878671:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873939200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.878676:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873940480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.878709:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873940480:12345-0@lo:400:kworker.0 Request processed in 36us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045577.878713:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784045577.878719:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873939200:12345-0@lo:400:kworker.0 Request processed in 49us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045577.878729:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784045577.878732:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784045577.878738:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873940352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.878755:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784045577.878765:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873939712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.878770:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1870706873940352:12345-0@lo:400:kworker.0 Request processed in 31us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045577.878776:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784045577.878815:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873939712:12345-0@lo:400:kworker.0 Request processed in 52us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045577.878821:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784045577.878828:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784045577.878836:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873940224:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784045577.878843:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784045577.878850:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784045577.878853:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784045577.878856:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045577.878875:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873940224:12345-0@lo:400:kworker.0 Request processed in 39us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045577.878881:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873939200:0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.878886:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784045577.878899:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873939712:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.878910:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873940224:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.878940:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873939840:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.878951:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1870706873940352:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.878976:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873938944 00000100:00100000:0.0:1784045577.878980:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873938944 00000100:00100000:0.0:1784045577.878998:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873939456 00000100:00100000:0.0:1784045577.879001:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873939456 00000100:00100000:0.0:1784045577.879012:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784045577.879017:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873938944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784045577.879030:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1784045577.879062:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873938944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (3248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045577.879068:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784045577.879079:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784045577.879085:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873939456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784045577.879094:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784045577.879106:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873939968:0@lo:400:kworker.0 00010000:00080000:1.0:1784045577.879121:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831f8380 x1870706873940480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784045577.879129:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873940480:0@lo:400:kworker.0 00000100:00100000:0.0:1784045577.879134:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3624:x1870706873939456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045577.879143:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873940608:0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.879154:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873938944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045577.879162:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873939584:0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.879167:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873940096:0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.879185:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b83382300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873939456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784045577.879304:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045577.879466:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784045577.879477:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873940736:0@lo:400:kworker.0 00000100:00100000:2.0:1784045577.879518:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045577.879542:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873940736 00000100:00100000:1.0:1784045577.879548:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873940736 00000100:00080000:0.0:1784045577.879616:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784045577.879659:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784045577.879668:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873940736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.879724:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873940736:12345-0@lo:400:kworker.0 Request processed in 58us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045577.879731:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1784045577.879769:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831f8700 x1870706873940736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045577.879778:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873940736:0@lo:400:kworker.0 00000100:00100000:1.0:1784045577.959747:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045577.959874:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863365248 00000100:00100000:0.0:1784045577.959884:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863365248 00000100:00100000:0.0:1784045577.959949:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 132 00000100:00100000:0.0:1784045577.959959:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+10:15031:x1870706863365248:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784045577.959984:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045577.960002:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc21fdc00/0x5475624df454dc1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73f2f9 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045577.960029:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc21fdc00/0x5475624df454dc1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f2f9 expref: 11 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045577.960040:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc21fdc00/0x5475624df454dc1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f2f9 expref: 11 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045577.960049:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fdc00, rc 0) 00000100:00100000:0.0:1784045577.960108:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+11:15031:x1870706863365248:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 151us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045577.960115:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 132 00000100:00100000:2.0:1784045577.968266:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045577.968377:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863365376 00000100:00100000:1.0:1784045577.968387:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863365376 00000100:00100000:1.0:1784045577.968482:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 133 00000100:00100000:1.0:1784045577.968492:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+11:15031:x1870706863365376:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784045577.968664:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+11:15031:x1870706863365376:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 173us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045577.968672:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 133 00000100:00100000:2.0:1784045577.970684:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045577.970772:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863365504 00000100:00100000:1.0:1784045577.970781:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863365504 00000100:00100000:1.0:1784045577.970833:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 134 00000100:00100000:1.0:1784045577.970843:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+11:15031:x1870706863365504:12345-192.168.203.44@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784045577.971031:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+11:15031:x1870706863365504:12345-192.168.203.44@tcp:503:mount.lustre.0 Request processed in 189us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045577.971040:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 134 00000100:00100000:3.0:1784045577.978601:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045577.979374:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863365632 00000100:00100000:0.0:1784045577.979386:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863365632 00000100:00100000:0.0:1784045577.979549:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 135 00000100:00100000:0.0:1784045577.979561:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+11:15040:x1870706863365632:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784045577.979728:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+11:15040:x1870706863365632:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 170us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045577.979747:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 135 00000100:00100000:0.0:1784045578.000478:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045578.001404:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863365760 00000100:00100000:2.0:1784045578.001415:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863365760 00000100:00100000:2.0:1784045578.001638:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 136 00000100:00100000:2.0:1784045578.001648:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+11:15040:x1870706863365760:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784045578.001817:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+11:15040:x1870706863365760:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 170us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045578.001826:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 136 00000100:00100000:2.0:1784045578.005212:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045578.005600:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863365888 00000100:00100000:0.0:1784045578.005610:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863365888 00000100:00100000:0.0:1784045578.005669:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 137 00000100:00100000:0.0:1784045578.005680:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+11:15040:x1870706863365888:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784045578.005847:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+11:15040:x1870706863365888:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 167us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045578.005856:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 137 00000100:00100000:3.0:1784045578.010196:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045578.010314:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863366016 00000100:00100000:2.0:1784045578.010337:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863366016 00000100:00100000:2.0:1784045578.010396:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 138 00000100:00100000:2.0:1784045578.010407:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+11:15031:x1870706863366016:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784045578.010425:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045578.010474:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81987200/0x5475624df454dc24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73f32a expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045578.010507:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987200/0x5475624df454dc24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f32a expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045578.010518:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81987200/0x5475624df454dc24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f32a expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045578.010528:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987200, rc 0) 00000100:00100000:2.0:1784045578.010589:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+12:15031:x1870706863366016:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 184us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045578.010596:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 138 00000100:00100000:2.0:1784045578.014473:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045578.016350:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863366144 00000100:00100000:1.0:1784045578.016364:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863366144 00000100:00100000:1.0:1784045578.016509:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 139 00000100:00100000:1.0:1784045578.016520:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+12:15031:x1870706863366144:12345-192.168.203.44@tcp:256:mount.lustre.0 20000000:01000000:1.0:1784045578.016559:0:17167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784045578.016586:0:17167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784045578.016590:0:17167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784045578.016598:0:17167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784045578.016601:0:17167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1784045578.016604:0:17167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1784045578.019581:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+12:15031:x1870706863366144:12345-192.168.203.44@tcp:256:mount.lustre.0 Request processed in 3052us (5137us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045578.019597:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 139 00000100:00100000:3.0:1784045578.021733:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045578.022672:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863366272 00000100:00100000:2.0:1784045578.022684:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863366272 00000100:00100000:2.0:1784045578.022738:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 140 00000100:00100000:2.0:1784045578.022749:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb69b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+12:15031:x1870706863366272:12345-192.168.203.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784045578.022764:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045578.022782:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81987600/0x5475624df454dc2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73f331 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045578.022810:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987600/0x5475624df454dc2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f331 expref: 13 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045578.022840:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81987600/0x5475624df454dc2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f331 expref: 13 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045578.022850:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987600, rc 0) 00000100:00100000:2.0:1784045578.022909:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb69b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+13:15031:x1870706863366272:12345-192.168.203.44@tcp:101:mount.lustre.0 Request processed in 162us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045578.022917:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 140 00000100:00100000:3.0:1784045578.025076:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045578.025126:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863366400 00000100:00100000:3.0:1784045578.025133:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863366400 00000100:00100000:3.0:1784045578.025180:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 141 00000100:00100000:3.0:1784045578.025188:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+13:15031:x1870706863366400:12345-192.168.203.44@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784045578.025357:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6aba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+13:15031:x1870706863366400:12345-192.168.203.44@tcp:501:mount.lustre.0 Request processed in 169us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045578.025366:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 141 00000100:00100000:3.0:1784045578.027282:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045578.027354:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863366528 00000100:00100000:1.0:1784045578.027364:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863366528 00000100:00100000:1.0:1784045578.027419:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 142 00000100:00100000:1.0:1784045578.027428:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+13:15031:x1870706863366528:12345-192.168.203.44@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784045578.027597:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6aba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+13:15031:x1870706863366528:12345-192.168.203.44@tcp:503:mount.lustre.0 Request processed in 169us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045578.027606:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 142 00000100:00100000:1.0:1784045578.029628:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045578.030139:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863366656 00000100:00100000:0.0:1784045578.030147:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863366656 00000100:00100000:0.0:1784045578.030235:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 143 00000100:00100000:0.0:1784045578.030245:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+13:15044:x1870706863366656:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784045578.030397:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+13:15044:x1870706863366656:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 153us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045578.030405:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 143 00000100:00100000:3.0:1784045578.032148:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045578.038329:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863366784 00000100:00100000:1.0:1784045578.038343:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863366784 00000100:00100000:1.0:1784045578.038396:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 144 00000100:00100000:1.0:1784045578.038407:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+13:15044:x1870706863366784:12345-192.168.203.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784045578.038695:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6aba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+13:15044:x1870706863366784:12345-192.168.203.44@tcp:502:llog_process_th.0 Request processed in 288us (6554us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045578.038703:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 144 00000100:00100000:3.0:1784045578.041912:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045578.041982:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045578.042013:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045578.042047:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045578.042078:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863367936 00000100:00100000:3.0:1784045578.042087:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863367936 00000100:00100000:3.0:1784045578.042139:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:3.0:1784045578.042148:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2397:x1870706863367936:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045578.042215:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2397:x1870706863367936:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 67us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045578.042222:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:3.0:1784045578.042251:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863366912 00000100:00100000:3.0:1784045578.042254:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863366912 00000100:00100000:3.0:1784045578.042286:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863367168 00000100:00100000:3.0:1784045578.042289:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863367168 00000100:00100000:3.0:1784045578.042299:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863367680 00000100:00100000:3.0:1784045578.042301:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863367680 00000100:00100000:3.0:1784045578.042317:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:3.0:1784045578.042322:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2397:x1870706863367680:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045578.042349:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2397:x1870706863367680:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045578.042356:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:3.0:1784045578.042367:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:3.0:1784045578.042371:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1870706863366912:12345-192.168.203.44@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784045578.042393:0:17174:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from afbadc4e-7e5b-40f4-aa1f-f579a0ff2353@192.168.203.44@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:3.0:1784045578.042427:0:17174:0:(genops.c:1406:class_connect()) connect: client afbadc4e-7e5b-40f4-aa1f-f579a0ff2353, cookie 0x5475624df454dc32 00000004:00100000:3.0:1784045578.042493:0:17174:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1784045578.042603:0:17174:0:(import.c:65:import_set_state_nolock()) ffff939cc0051800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045578.042633:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:2393:x1870706863366912:12345-192.168.203.44@tcp:38:mount.lustre.0 Request processed in 259us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045578.042640:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:3.0:1784045578.042653:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:3.0:1784045578.042657:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1870706863367168:12345-192.168.203.44@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784045578.042672:0:17174:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from afbadc4e-7e5b-40f4-aa1f-f579a0ff2353@192.168.203.44@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:3.0:1784045578.042691:0:17174:0:(genops.c:1406:class_connect()) connect: client afbadc4e-7e5b-40f4-aa1f-f579a0ff2353, cookie 0x5475624df454dc39 00000004:00100000:3.0:1784045578.042703:0:17174:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1784045578.042760:0:17174:0:(import.c:65:import_set_state_nolock()) ffff939cc0053800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784045578.042785:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:2393:x1870706863367168:12345-192.168.203.44@tcp:38:mount.lustre.0 Request processed in 126us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045578.042792:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:3.0:1784045578.042836:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045578.042895:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045578.042959:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863367808 00000100:00100000:3.0:1784045578.042964:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863367808 00000100:00100000:3.0:1784045578.042988:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:3.0:1784045578.042995:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2397:x1870706863367808:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045578.043025:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2397:x1870706863367808:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 30us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045578.043030:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:3.0:1784045578.043046:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863367552 00000100:00100000:3.0:1784045578.043049:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863367552 00000100:00100000:3.0:1784045578.043068:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:3.0:1784045578.043073:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:2397:x1870706863367552:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045578.043104:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:2397:x1870706863367552:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 31us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045578.043111:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:3.0:1784045578.046792:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045578.046840:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045578.046876:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045578.046908:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863367424 00000100:00100000:3.0:1784045578.046917:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863367424 00000100:00100000:1.0:1784045578.050409:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863367296 00000100:00100000:1.0:1784045578.050423:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863367296 00000100:00100000:1.0:1784045578.050519:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863367040 00000100:00100000:1.0:1784045578.050523:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863367040 00000100:00100000:1.0:1784045578.050545:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:1.0:1784045578.050554:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:0:x1870706863367296:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784045578.050608:0:18705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1784045578.050684:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:0:x1870706863367296:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 131us (3844us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045578.050691:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:1.0:1784045578.050713:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:1.0:1784045578.050720:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+7:0:x1870706863367040:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784045578.050736:0:18705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784045578.050761:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+7:0:x1870706863367040:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 42us (3885us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045578.050767:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:3.0:1784045578.051041:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:3.0:1784045578.051052:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:15031:x1870706863367424:12345-192.168.203.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784045578.051067:0:17172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1784045578.051094:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:15031:x1870706863367424:12345-192.168.203.44@tcp:41:mount.lustre.0 Request processed in 45us (4311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045578.051100:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00080000:3.0:1784045578.051119:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784045578.051123:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045578.054667:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045578.054756:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863368064 00000100:00100000:1.0:1784045578.054765:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863368064 00000100:00100000:1.0:1784045578.054821:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:1.0:1784045578.054831:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:15031:x1870706863368064:12345-192.168.203.44@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784045578.054922:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:15031:x1870706863368064:12345-192.168.203.44@tcp:40:mount.lustre.0 Request processed in 92us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045578.054938:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:3.0:1784045578.058778:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045578.058829:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045578.058864:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045578.059061:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863368192 00000100:00100000:0.0:1784045578.059071:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863368192 00000100:00100000:0.0:1784045578.059114:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863368320 00000100:00100000:0.0:1784045578.059117:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863368320 00000100:00100000:0.0:1784045578.059132:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:0.0:1784045578.059140:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1870706863368192:12345-192.168.203.44@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784045578.059171:0:18683:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from afbadc4e-7e5b-40f4-aa1f-f579a0ff2353@192.168.203.44@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:0.0:1784045578.059203:0:18683:0:(genops.c:1406:class_connect()) connect: client afbadc4e-7e5b-40f4-aa1f-f579a0ff2353, cookie 0x5475624df454dc40 00002000:00100000:0.0:1784045578.059214:0:18683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli afbadc4e-7e5b-40f4-aa1f-f579a0ff2353/ffff939cbc5d4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784045578.059239:0:18683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1784045578.059333:0:18683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784045578.059360:0:18683:0:(import.c:65:import_set_state_nolock()) ffff939cbc5d4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045578.059418:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:2393:x1870706863368192:12345-192.168.203.44@tcp:8:mount.lustre.0 Request processed in 278us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045578.059426:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:0.0:1784045578.059440:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:0.0:1784045578.059479:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1870706863368320:12345-192.168.203.44@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784045578.059494:0:18683:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from afbadc4e-7e5b-40f4-aa1f-f579a0ff2353@192.168.203.44@tcp t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:0.0:1784045578.059522:0:18683:0:(genops.c:1406:class_connect()) connect: client afbadc4e-7e5b-40f4-aa1f-f579a0ff2353, cookie 0x5475624df454dc47 00002000:00100000:0.0:1784045578.059537:0:18683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli afbadc4e-7e5b-40f4-aa1f-f579a0ff2353/ffff939cbb736800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784045578.059543:0:18683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1784045578.059589:0:18683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784045578.059603:0:18683:0:(import.c:65:import_set_state_nolock()) ffff939cbb737000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784045578.059625:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:2393:x1870706863368320:12345-192.168.203.44@tcp:8:mount.lustre.0 Request processed in 145us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045578.059631:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:1.0:1784045578.060308:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863368448 00000100:00100000:1.0:1784045578.060315:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863368448 00000100:00100000:1.0:1784045578.060360:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:1.0:1784045578.060368:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:15031:x1870706863368448:12345-192.168.203.44@tcp:900:mount.lustre.0 00000100:00100000:1.0:1784045578.060412:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:15031:x1870706863368448:12345-192.168.203.44@tcp:900:mount.lustre.0 Request processed in 45us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045578.060419:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 4 00000001:00100000:1.0:1784045578.062833:0:19497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of afbadc4e-7e5b-40f4-aa1f-f579a0ff2353 00000001:00100000:1.0:1784045578.062845:0:19497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5c4ec1df-89f5-44e3-9b84-9820a7989c32 00000001:00080000:1.0:1784045578.062852:0:19497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1784045578.063755:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045578.063862:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863368576 00000100:00100000:2.0:1784045578.063871:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863368576 00000100:00100000:2.0:1784045578.063925:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:2.0:1784045578.063945:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:15031:x1870706863368576:12345-192.168.203.44@tcp:33:mount.lustre.0 00000004:00200000:2.0:1784045578.064034:0:17176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784045578.064115:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:15031:x1870706863368576:12345-192.168.203.44@tcp:33:mount.lustre.0 Request processed in 171us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045578.064123:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:3.0:1784045578.180654:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045578.180809:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863368704 00000100:00100000:0.0:1784045578.180819:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863368704 00000100:00100000:0.0:1784045578.180881:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:0.0:1784045578.180891:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:15067:x1870706863368704:12345-192.168.203.44@tcp:101:mkdir.0 00010000:00010000:0.0:1784045578.180911:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045578.180932:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd400/0x5475624df454dc4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f362 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045578.181023:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454dc55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045578.181036:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454dc55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045578.181049:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454dc55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045578.181090:0:17174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784045578.181095:0:17174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784045578.181116:0:17174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454dc55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045578.181139:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd400/0x5475624df454dc4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f362 expref: 8 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045578.181158:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454dc55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f362 expref: 7 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045578.181165:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:0.0:1784045578.181168:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784045578.181171:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fd600, rc 0) 00000100:00100000:0.0:1784045578.181231:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+7:15067:x1870706863368704:12345-192.168.203.44@tcp:101:mkdir.0 Request processed in 341us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045578.181239:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00010000:00010000:1.0:1784045578.259726:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045579.284938:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045579.416574:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045579.416601:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873940864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784045579.416670:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045579.417349:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873940864 00000100:00100000:3.0:1784045579.417361:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873940864 00000100:00100000:3.0:1784045579.417475:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784045579.417486:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873940864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784045579.417517:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784045579.417600:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873940864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045579.417608:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1784045579.417801:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045579.417998:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873940864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784045579.925082:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873940992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045579.925162:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045579.925216:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873940992 00000100:00100000:0.0:1784045579.925223:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873940992 00000100:00100000:0.0:1784045579.925283:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784045579.925291:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873940992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784045579.925322:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1784045579.925362:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873940992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045579.925369:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784045579.925405:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873940992:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784045579.930403:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784045579.930427:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873941120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784045579.930530:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045579.930586:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873941120 00000100:00100000:0.0:1784045579.930594:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873941120 00000100:00100000:0.0:1784045579.930637:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784045579.930646:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873941120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784045579.930678:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1784045579.930722:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873941120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045579.930729:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784045579.930776:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873941120:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784045580.309089:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045580.438136:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873941248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045580.438233:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045580.438422:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873941248 00000100:00100000:3.0:1784045580.438432:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873941248 00000100:00100000:3.0:1784045580.438533:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784045580.438544:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873941248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045580.438574:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784045580.438639:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873941248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045580.438647:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1784045580.438777:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045580.438824:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873941248:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1784045580.705930:0:20055:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1784045580.953827:0:17905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of afbadc4e-7e5b-40f4-aa1f-f579a0ff2353 00000001:00100000:2.0:1784045580.953844:0:17905:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5c4ec1df-89f5-44e3-9b84-9820a7989c32 00000001:00100000:3.0:1784045580.954220:0:17152:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of afbadc4e-7e5b-40f4-aa1f-f579a0ff2353 00000001:00100000:3.0:1784045580.954229:0:17152:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5c4ec1df-89f5-44e3-9b84-9820a7989c32 00010000:00010000:1.0:1784045581.331777:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784045581.980334:0:18677:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of afbadc4e-7e5b-40f4-aa1f-f579a0ff2353 00000001:00100000:1.0:1784045581.980347:0:18677:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5c4ec1df-89f5-44e3-9b84-9820a7989c32 00010000:00010000:3.0:1784045582.356668:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784045582.935365:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784045582.996184:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873941376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045582.996266:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045582.996357:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873941376 00000100:00100000:2.0:1784045582.996366:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873941376 00000100:00100000:2.0:1784045582.996419:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784045582.996429:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873941376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784045582.996492:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1784045582.996546:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873941376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045582.996553:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1784045582.996573:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784045582.996677:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873941632:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.996706:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045582.996732:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873942144:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.996753:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045582.996769:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873942656:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.996794:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045582.996815:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1784045582.996821:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c25407c2-0928-423d-881e-1585e6e3cc3c:3624:1870706873941504:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.996846:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045582.996868:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873942016:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.996887:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045582.996904:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873942528:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.996923:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045582.996948:0:17913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873941632 00000100:00100000:2.0:1784045582.996952:0:17913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873941632 00000100:00100000:2.0:1784045582.996973:0:17913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873942144 00000100:00100000:2.0:1784045582.996975:0:17913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873942144 00000100:00100000:2.0:1784045582.996987:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784045582.997000:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873941632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997036:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873941632:12345-0@lo:400:kworker.0 Request processed in 37us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045582.997043:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784045582.997054:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784045582.997059:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873942144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997083:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873942144:12345-0@lo:400:kworker.0 Request processed in 24us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045582.997089:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784045582.997108:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873942656 00000100:00100000:2.0:1784045582.997112:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873942656 00000100:00100000:2.0:1784045582.997139:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873942016 00000100:00100000:2.0:1784045582.997141:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873942016 00000100:00100000:2.0:1784045582.997151:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873942528 00000100:00100000:2.0:1784045582.997153:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873942528 00000100:00100000:2.0:1784045582.997165:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784045582.997170:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873942656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997197:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873942656:12345-0@lo:400:kworker.0 Request processed in 27us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045582.997204:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784045582.997215:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784045582.997220:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873942016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997256:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873942016:12345-0@lo:400:kworker.0 Request processed in 35us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045582.997262:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784045582.997272:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784045582.997278:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873942528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997310:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873942528:12345-0@lo:400:kworker.0 Request processed in 34us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045582.997316:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784045582.997334:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873941504 00000100:00100000:2.0:1784045582.997337:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873941504 00000100:00100000:2.0:1784045582.997358:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784045582.997363:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+24:3624:x1870706873941504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997389:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+24:3624:x1870706873941504:12345-0@lo:400:kworker.0 Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045582.997395:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784045582.997424:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873941760:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997470:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045582.997490:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873942272:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997510:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045582.997525:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873942784:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997547:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045582.997563:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784045582.997568:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873941888:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997590:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045582.997605:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873942400:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997624:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045582.997637:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873942912:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997655:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045582.997674:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873941760 00000100:00100000:2.0:1784045582.997677:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873941760 00000100:00100000:2.0:1784045582.997710:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873942272 00000100:00100000:2.0:1784045582.997713:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873942272 00000100:00100000:2.0:1784045582.997731:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873941888 00000100:00100000:2.0:1784045582.997734:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873941888 00000100:00100000:2.0:1784045582.997749:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045582.997755:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873941760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997788:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873941760:12345-0@lo:400:kworker.0 Request processed in 32us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045582.997794:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045582.997805:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045582.997812:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873942272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997835:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873942272:12345-0@lo:400:kworker.0 Request processed in 24us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045582.997840:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784045582.997849:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045582.997854:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873941888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997876:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873941888:12345-0@lo:400:kworker.0 Request processed in 22us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045582.997881:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784045582.997898:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873942784 00000100:00100000:2.0:1784045582.997902:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873942784 00000100:00100000:2.0:1784045582.997918:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873942400 00000100:00100000:2.0:1784045582.997920:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873942400 00000100:00100000:2.0:1784045582.997929:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873942912 00000100:00100000:2.0:1784045582.997931:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873942912 00000100:00100000:2.0:1784045582.997942:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784045582.997948:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873942784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.997977:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1870706873942784:12345-0@lo:400:kworker.0 Request processed in 29us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045582.997989:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784045582.998000:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784045582.998005:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873942400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.998030:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1870706873942400:12345-0@lo:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045582.998035:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784045582.998045:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784045582.998050:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873942912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.998091:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1870706873942912:12345-0@lo:400:kworker.0 Request processed in 40us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045582.998096:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1784045582.998113:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045582.998116:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045582.998118:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784045582.998120:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784045582.998152:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873941376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784045582.998201:0:3625:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1784045582.998213:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873941888:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.998222:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1870706873942400:0@lo:400:kworker.0 00010000:00080000:2.0:1784045582.998232:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831f8e00 x1870706873942912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045582.998252:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1870706873942912:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.998262:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873941760:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.998280:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873942272:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.998287:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1870706873942784:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.998314:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c25407c2-0928-423d-881e-1585e6e3cc3c:3624:1870706873941504:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.998322:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873942016:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.998331:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873942528:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.998340:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873941632:0@lo:400:kworker.0 00000100:00100000:2.0:1784045582.998349:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873942144:0@lo:400:kworker.0 00010000:00080000:2.0:1784045582.998360:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939b831f9500 x1870706873942656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045598 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045582.998368:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873942656:0@lo:400:kworker.0 00000100:00100000:3.0:1784045583.008903:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873943040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045583.008972:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045583.009026:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873943040 00000100:00100000:3.0:1784045583.009033:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873943040 00000100:00100000:3.0:1784045583.009073:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784045583.009082:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873943040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784045583.009104:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784045583.009146:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873943040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045583.009154:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784045583.009197:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873943040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784045583.379719:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045583.551484:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045583.551545:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045583.551578:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045583.551602:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045583.551628:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045583.551649:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045583.551665:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045583.551682:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045583.551708:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045583.551741:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863368960 00000100:00100000:3.0:1784045583.551751:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863368960 00000100:00100000:3.0:1784045583.551807:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863369472 00000100:00100000:3.0:1784045583.551810:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863369472 00000100:00100000:3.0:1784045583.551823:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863369088 00000100:00100000:3.0:1784045583.551826:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863369088 00000100:00100000:3.0:1784045583.551838:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863369600 00000100:00100000:3.0:1784045583.551841:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863369600 00000100:00100000:3.0:1784045583.551859:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:3.0:1784045583.551868:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2395:x1870706863368960:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045583.551950:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2395:x1870706863368960:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 81us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045583.551958:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:3.0:1784045583.551974:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:3.0:1784045583.551981:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:2395:x1870706863369472:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045583.552006:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:2395:x1870706863369472:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045583.552039:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:3.0:1784045583.552053:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:3.0:1784045583.552059:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2395:x1870706863369088:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045583.552085:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2395:x1870706863369088:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 27us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045583.552091:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:1.0:1784045583.552214:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863369216 00000100:00100000:1.0:1784045583.552219:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863369216 00000100:00100000:1.0:1784045583.552261:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863369728 00000100:00100000:1.0:1784045583.552265:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863369728 00000100:00100000:1.0:1784045583.552281:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863369344 00000100:00100000:1.0:1784045583.552284:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863369344 00000100:00100000:1.0:1784045583.552297:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863369856 00000100:00100000:1.0:1784045583.552300:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863369856 00000100:00100000:1.0:1784045583.552312:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:1.0:1784045583.552318:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2395:x1870706863369216:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045583.552346:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2395:x1870706863369216:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 27us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045583.552353:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:1.0:1784045583.552371:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:1.0:1784045583.552378:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2395:x1870706863369728:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045583.552402:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2395:x1870706863369728:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045583.552416:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:1.0:1784045583.552428:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:1.0:1784045583.552435:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2395:x1870706863369344:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045583.552483:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2395:x1870706863369344:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 48us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045583.552490:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:1.0:1784045583.552502:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:1.0:1784045583.552508:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb677bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2395:x1870706863369856:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045583.552531:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb677bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2395:x1870706863369856:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 23us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045583.552536:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:3.0:1784045583.552768:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:3.0:1784045583.552779:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2395:x1870706863369600:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045583.552806:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2395:x1870706863369600:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 31us (1124us total) trans 0 rc 0/0 00000100:00080000:2.0:1784045583.559248:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784045583.559258:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045583.559261:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784045583.559263:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784045583.559289:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863368832 00000100:00100000:2.0:1784045583.559298:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863368832 00000100:00100000:2.0:1784045583.559356:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 146 00000100:00100000:2.0:1784045583.559366:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+13:2395:x1870706863368832:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045583.559426:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+13:2395:x1870706863368832:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 62us (7797us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045583.559433:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 146 00000100:00100000:3.0:1784045583.569158:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 53 00000020:00000080:1.0:1784045584.051882:0:20202:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff606bbc90 20000000:00000080:1.0:1784045584.051898:0:20202:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff939cc017bc00 uarg=0000000000000000 20000000:01000000:1.0:1784045584.051942:0:20202:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784045584.051947:0:20202:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784045584.051952:0:20202:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784045584.059116:0:20203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1784045584.059506:0:20202:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784045584.067697:0:20202:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784045584.067729:0:20202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.067745:0:20202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b836cd600/0x5475624df454d8f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d8ea expref: 23 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.067753:0:20202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c93632a00/0x5475624df454d8ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d8f8 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.067760:0:20202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939c918b2e00/0x5475624df454d93e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454d937 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.067765:0:20202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b836cda00/0x5475624df454da9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454da95 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.067854:0:20202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b836cc600/0x5475624df454dbec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f2c1 expref: 12 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.067861:0:20202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff939b81987600/0x5475624df454dc2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f331 expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.067867:0:20202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.067909:0:20202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b81987600/0x5475624df454dc2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f331 expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.067925:0:20202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939b81987600/0x5475624df454dc2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f331 expref: 12 pid: 17164 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045584.067939:0:20202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1870706873943168:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045584.068037:0:20202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b836cc600/0x5475624df454dbec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f2c1 expref: 12 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.068046:0:20202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939b836cc600/0x5475624df454dbec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f2c1 expref: 12 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045584.068056:0:20202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1870706873943296:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045584.068091:0:20202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b836cda00/0x5475624df454da9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454da95 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.068099:0:20202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939b836cda00/0x5475624df454da9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454da95 expref: 23 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045584.068120:0:20202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1870706873943424:0@lo:104: 00000100:00100000:2.0:1784045584.068313:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045584.068353:0:20202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c918b2e00/0x5475624df454d93e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454d937 expref: 23 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.068365:0:20202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939c918b2e00/0x5475624df454d93e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454d937 expref: 23 pid: 17166 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045584.068375:0:20202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88337100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1870706873943552:0@lo:104: 00000100:00100000:0.0:1784045584.068385:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873943424 00000100:00100000:0.0:1784045584.068394:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873943424 00000100:00100000:2.0:1784045584.068401:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045584.068433:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873943552 00010000:00010000:2.0:1784045584.068440:0:20202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939c93632a00/0x5475624df454d8ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454d8f8 expref: 23 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.068471:0:20202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939c93632a00/0x5475624df454d8ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454d8f8 expref: 23 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045584.068482:0:20202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88337480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1870706873943680:0@lo:104: 00000100:00100000:1.0:1784045584.068484:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784045584.068500:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+3:20202:x1870706873943424:12345-0@lo:104: 00000100:00100000:2.0:1784045584.068514:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784045584.068515:0:17156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454da9c expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.068553:0:20202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff939b836cd600/0x5475624df454d8f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5475624df454d8ea expref: 23 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.068563:0:20202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff939b836cd600/0x5475624df454d8f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5475624df454d8ea expref: 23 pid: 17164 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.068571:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784045584.068574:0:20202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88337800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1870706873943808:0@lo:104: 00000100:00100000:1.0:1784045584.068581:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+3:20202:x1870706873943424:12345-0@lo:104: Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045584.068590:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784045584.068603:0:20202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045584.068616:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873943680 00000100:00100000:2.0:1784045584.068618:0:20202:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c878e1540 going to sleep for 11 seconds 00000100:00100000:1.0:1784045584.068622:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873943680 00000100:00100000:2.0:1784045584.068642:0:20202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1870706873943424:0@lo:104: 00000100:00100000:1.0:1784045584.068644:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873943808 00000100:00100000:1.0:1784045584.068649:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873943808 00010000:00010000:3.0:1784045584.068658:0:19790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1784045584.068660:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873943552 00010000:00010000:3.0:1784045584.068666:0:19790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454da9c expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045584.068670:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1784045584.068680:0:19790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987800 already unused, calling callback (ffffffffc13c0c20) 00000100:00100000:1.0:1784045584.068684:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+5:20202:x1870706873943680:12345-0@lo:104: 10000000:00010000:3.0:1784045584.068687:0:19790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454da9c expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.068695:0:17156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d8ff expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.068699:0:19790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454da9c expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784045584.068713:0:19790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454da9c expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784045584.068720:0:19790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784045584.068813:0:19790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454da9c expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.068830:0:19790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045584.068851:0:19790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454da9c expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.068858:0:19790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b81987800/0x5475624df454da95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454da9c expref: -99 pid: 19496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.068869:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1784045584.068872:0:19790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045584.068877:0:19790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d8ff expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045584.068878:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+5:20202:x1870706873943680:12345-0@lo:104: Request processed in 198us (364us total) trans 0 rc 0/0 00010000:00010000:2.0:1784045584.068893:0:19790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b836cce00 already unused, calling callback (ffffffffc13c0c20) 00000100:00100000:3.0:1784045584.068894:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 10000000:00010000:2.0:1784045584.068897:0:19790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454d8ff expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.068905:0:19790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454d8ff expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045584.068911:0:19790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454d8ff expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045584.068917:0:19790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1784045584.068920:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784045584.068930:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+4:20202:x1870706873943808:12345-0@lo:104: 00010000:00010000:2.0:1784045584.068934:0:19790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d8ff expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.068939:0:17156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d8f1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.068942:0:19790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045584.068959:0:19790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d8ff expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.068973:0:19790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939b836cce00/0x5475624df454d8f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d8ff expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.068980:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784045584.068990:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+4:20202:x1870706873943808:12345-0@lo:104: Request processed in 61us (386us total) trans 0 rc 0/0 00010000:00010000:2.0:1784045584.068996:0:19790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045584.069002:0:19790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d8f1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045584.069010:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1784045584.069014:0:19790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3e00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1784045584.069018:0:19790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454d8f1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.069026:0:19790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454d8f1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045584.069032:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 10000000:00010000:2.0:1784045584.069040:0:19790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454d8f1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045584.069043:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+3:20202:x1870706873943552:12345-0@lo:104: 10000000:01000000:2.0:1784045584.069054:0:19790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784045584.069056:0:17156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d93e expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.069071:0:19790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d8f1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.069079:0:19790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045584.069087:0:19790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d8f1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.069089:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784045584.069098:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+3:20202:x1870706873943552:12345-0@lo:104: Request processed in 57us (696us total) trans 0 rc 0/0 00010000:00010000:2.0:1784045584.069098:0:19790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c918b3e00/0x5475624df454d8ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d8f1 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045584.069112:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1784045584.069118:0:19790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045584.069123:0:19790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5475624df454d93e expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.069130:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045584.069136:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045584.069142:0:19790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c918b3c00 already unused, calling callback (ffffffffc13c0c20) 10000000:00010000:2.0:1784045584.069146:0:19790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5475624df454d93e expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045584.069154:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1784045584.069155:0:19790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5475624df454d93e expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784045584.069164:0:19790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5475624df454d93e expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045584.069168:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873943936:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1784045584.069173:0:19790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784045584.069190:0:19790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d93e expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.069196:0:19790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784045584.069203:0:19790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d93e expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.069209:0:19790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.144@tcp lock: ffff939c918b3c00/0x5475624df454d937 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5475624df454d93e expref: -99 pid: 18676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045584.069215:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784045584.069229:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045584.069263:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873944320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784045584.069268:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045584.069273:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784045584.069288:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045584.069339:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873943936 00000100:00100000:3.0:1784045584.069343:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873943936 00010000:00010000:3.0:1784045584.069360:0:17157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b836cda00/0x5475624df454da9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454da95 expref: 24 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045584.069365:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873944064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045584.069386:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873944320 00000100:00100000:3.0:1784045584.069391:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873944320 00000100:00100000:2.0:1784045584.069401:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784045584.069406:0:17157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c918b2e00/0x5475624df454d93e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d937 expref: 25 pid: 17166 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045584.069421:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873944064 00000100:00100000:2.0:1784045584.069427:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784045584.069431:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873944064 00000100:00100000:2.0:1784045584.069437:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873944192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784045584.069441:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1784045584.069466:0:17157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939c93632a00/0x5475624df454d8ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d8f8 expref: 26 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045584.069481:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+26:3623:x1870706873943936:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045584.069483:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784045584.069489:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+26:3623:x1870706873944320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784045584.069492:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045584.069495:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045584.069499:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c918b2e00/0x5475624df454d93e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d937 expref: 26 pid: 17166 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045584.069499:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b836cda00/0x5475624df454da9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454da95 expref: 26 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045584.069509:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b836cda00/0x5475624df454da9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454da95 expref: 26 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045584.069517:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045584.069555:0:17927:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1784045584.069561:0:17927:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:3.0:1784045584.069595:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c918b2e00/0x5475624df454d93e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454d937 expref: 26 pid: 17166 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.069611:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045584.069650:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+26:3623:x1870706873944320:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045584.069658:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784045584.069674:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873944192 00000100:00100000:3.0:1784045584.069677:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784045584.069679:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873944192 00010000:00010000:2.0:1784045584.069698:0:17927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b836cd600/0x5475624df454d8f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d8ea expref: 26 pid: 17164 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045584.069714:0:17927:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1784045584.069721:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045584.069727:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c25407c2-0928-423d-881e-1585e6e3cc3c+26:3625:x1870706873944192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784045584.069735:0:17927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045584.069740:0:17927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b836cd600/0x5475624df454d8f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d8ea expref: 26 pid: 17164 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.069748:0:17927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b836cd600/0x5475624df454d8f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454d8ea expref: 26 pid: 17164 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045584.069757:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+26:3625:x1870706873944064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784045584.069761:0:17927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045584.069767:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045584.069778:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939c93632a00/0x5475624df454d8ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5475624df454d8f8 expref: 26 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.069789:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939c93632a00/0x5475624df454d8ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5475624df454d8f8 expref: 26 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045584.069795:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c25407c2-0928-423d-881e-1585e6e3cc3c+26:3625:x1870706873944192:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (281us total) trans 0 rc 0/0 00010000:00010000:3.0:1784045584.069804:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045584.069804:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784045584.069841:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873944192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045584.069843:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c25407c2-0928-423d-881e-1585e6e3cc3c+25:3625:x1870706873944064:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045584.069856:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873944064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784045584.069866:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784045584.069913:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873944320:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784045584.070281:0:20202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c93632a00/0x5475624df454d8ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454d8f8 expref: 24 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045584.070294:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b836cda00/0x5475624df454da9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454da95 expref: 23 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045584.070298:0:20202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88337480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1870706873943680:0@lo:104: 00010000:00010000:0.0:1784045584.070314:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045584.070350:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c25407c2-0928-423d-881e-1585e6e3cc3c+22:3623:x1870706873943936:12345-0@lo:103:ldlm_bl.0 Request processed in 872us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045584.070356:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1784045584.070378:0:20202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b836cd600/0x5475624df454d8f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454d8ea expref: 21 pid: 17164 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045584.070390:0:20202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88337800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1870706873943808:0@lo:104: 00010000:00010000:2.0:1784045584.070752:0:20202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939c918b2e00/0x5475624df454d93e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5475624df454d937 expref: 20 pid: 17166 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045584.070763:0:20202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88337100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1870706873943552:0@lo:104: 00000100:00100000:3.0:1784045584.073951:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c25407c2-0928-423d-881e-1585e6e3cc3c:3623:1870706873943936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784045584.074344:0:20202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1870706873943168:192.168.203.44@tcp:104: 00000100:00100000:0.0:1784045584.074354:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045584.074363:0:20202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20202:1870706873943296:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045584.074402:0:20202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045584.074474:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045584.074513:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863370112 00000100:00100000:1.0:1784045584.074521:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863370112 00010000:00010000:1.0:1784045584.074556:0:17157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b836cc600/0x5475624df454dbec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f2c1 expref: 13 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045584.074587:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863369984 00000100:00100000:1.0:1784045584.074590:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863369984 00010000:00010000:1.0:1784045584.074602:0:17157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff939b81987600/0x5475624df454dc2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f331 expref: 14 pid: 17164 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045584.074628:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:1.0:1784045584.074637:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b834cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f86ebe-963e-4824-a274-0f8b57132670+14:2394:x1870706863370112:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045584.074653:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045584.074659:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b836cc600/0x5475624df454dbec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f2c1 expref: 14 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074668:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b836cc600/0x5475624df454dbec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f2c1 expref: 14 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074701:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b836cc600/0x5475624df454dbec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f2c1 expref: 14 pid: 17167 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074718:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045584.074769:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b834cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f86ebe-963e-4824-a274-0f8b57132670+13:2394:x1870706863370112:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 132us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045584.074776:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 13 00000100:00100000:1.0:1784045584.074822:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 14 00000100:00100000:1.0:1784045584.074828:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f86ebe-963e-4824-a274-0f8b57132670+12:2394:x1870706863369984:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045584.074836:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045584.074840:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff939b81987600/0x5475624df454dc2b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f331 expref: 12 pid: 17164 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074850:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff939b81987600/0x5475624df454dc2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f331 expref: 12 pid: 17164 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074861:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939b81987600/0x5475624df454dc2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f331 expref: 12 pid: 17164 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074872:0:17157:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074880:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074894:0:17157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074910:0:17157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074917:0:17157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074923:0:17157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074929:0:17157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106e800 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:1.0:1784045584.074934:0:17157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074942:0:17157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074953:0:17157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045584.074962:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045584.074981:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0f86ebe-963e-4824-a274-0f8b57132670+11:2394:x1870706863369984:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 153us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045584.074987:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 14 00010000:00010000:2.0:1784045584.075145:0:20202:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.075154:0:20202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045584.075161:0:20202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff939cc106e800/0x5475624df454dc5c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045584.404134:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045584.531602:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784045584.531627:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873944448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784045584.531690:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045584.531734:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873944448 00000100:00100000:1.0:1784045584.531741:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873944448 00000100:00100000:1.0:1784045584.531792:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784045584.531810:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873944448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784045584.531839:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1784045584.531881:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1870706873944448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045584.531887:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784045584.531953:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1870706873944448:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1784045584.532180:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784045585.046856:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045585.046880:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873944576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784045585.046966:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045585.047014:0:17913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873944576 00000100:00100000:1.0:1784045585.047021:0:17913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873944576 00000100:00100000:1.0:1784045585.047071:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784045585.047078:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873944576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784045585.047111:0:17913:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1784045585.047154:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873944576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045585.047161:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784045585.047211:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873944576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045585.049152:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784045585.049174:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873944704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045585.049244:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045585.049290:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873944704 00000100:00100000:2.0:1784045585.049297:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873944704 00000100:00100000:2.0:1784045585.049343:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784045585.049352:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873944704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784045585.049383:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1784045585.049425:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1870706873944704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045585.049461:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784045585.049506:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1870706873944704:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784045585.437436:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045585.556774:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873944832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784045585.556847:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045585.557110:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873944832 00000100:00100000:3.0:1784045585.557119:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873944832 00000100:00100000:3.0:1784045585.557189:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784045585.557199:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873944832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045585.557278:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1784045585.557325:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873944832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045585.557332:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1784045585.557515:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784045585.557552:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873944832:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1784045585.748515:0:17169:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784045585.748523:0:17169:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939cbc5d1000 from 13 10000000:01000000:3.0:1784045585.748529:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784045585.748571:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106ec00/0x5475624df454dc63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045585.748583:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939cc106ec00/0x5475624df454dc63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045585.748594:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939cc106ec00/0x5475624df454dc63 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045585.748619:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873944960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784045585.748679:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045585.748722:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c83d63240 going to sleep for 11 seconds 00000100:00100000:0.0:1784045585.754420:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873944960 00000100:00100000:0.0:1784045585.754435:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873944960 00000100:00100000:0.0:1784045585.754529:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784045585.754541:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+20:17169:x1870706873944960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045585.754559:0:17166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045585.754579:0:17166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc21fc400/0x5475624df454dc6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454dc63 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045585.754607:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc21fc400/0x5475624df454dc6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454dc63 expref: 21 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045585.754630:0:17166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc21fc400/0x5475624df454dc6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454dc63 expref: 21 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045585.754638:0:17166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fc400, rc 0) 00000100:00100000:0.0:1784045585.754712:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+21:17169:x1870706873944960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (6032us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045585.754719:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784045585.754778:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873944960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045585.754796:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939cc106ec00/0x5475624df454dc63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dc6a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045585.754806:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939cc106ec00/0x5475624df454dc63 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454dc6a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045585.754890:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045585.754920:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045585.754950:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a7a600 going to sleep for 11 seconds 00000100:00100000:0.0:1784045585.754971:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873945088 00000100:00100000:0.0:1784045585.754975:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873945088 00000100:00100000:0.0:1784045585.754996:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784045585.755002:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:17169:x1870706873945088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045585.755108:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:17169:x1870706873945088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045585.755115:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784045585.755138:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045585.755168:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb6848380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045585.755200:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045585.755211:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a7a600 going to sleep for 11 seconds 00000100:00100000:0.0:1784045585.755236:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873945216 00000100:00100000:0.0:1784045585.755240:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873945216 00000100:00100000:0.0:1784045585.755255:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784045585.755259:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:17169:x1870706873945216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045585.756430:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:17169:x1870706873945216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1166us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045585.756441:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784045585.758168:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb6848380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784045585.762134:0:20269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784045585.762197:0:17169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784045585.762216:0:17169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784045585.762236:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939cc106ec00/0x5475624df454dc63 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dc6a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045585.762248:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939cc106ec00/0x5475624df454dc63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dc6a expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045585.763072:0:17169:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784045585.763076:0:17169:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939cb658c000 from 13 10000000:01000000:1.0:1784045585.763080:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784045585.763117:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454dc71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045585.763126:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454dc71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045585.763136:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454dc71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045585.763160:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045585.763234:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045585.763292:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb687dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784045585.765583:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873945344 00000100:00100000:1.0:1784045585.765594:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873945344 00000100:00100000:1.0:1784045585.765646:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784045585.765656:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+21:17169:x1870706873945344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045585.765671:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045585.765688:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939c93e79600/0x5475624df454dc78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454dc71 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045585.765714:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939c93e79600/0x5475624df454dc78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454dc71 expref: 22 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045585.765723:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939c93e79600/0x5475624df454dc78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454dc71 expref: 22 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045585.765743:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93e79600, rc 0) 00000100:00100000:1.0:1784045585.765809:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+22:17169:x1870706873945344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (2587us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045585.765816:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784045585.765874:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045585.766378:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454dc71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dc78 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045585.766389:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454dc71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454dc78 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045585.766498:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045585.766534:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045585.766570:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb687dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784045585.766596:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873945472 00000100:00100000:1.0:1784045585.766601:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873945472 00000100:00100000:1.0:1784045585.766627:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784045585.766633:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+22:17169:x1870706873945472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045585.766738:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+22:17169:x1870706873945472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045585.766745:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784045585.766785:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045585.766811:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784045585.766849:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045585.766881:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873945600 00000100:00100000:2.0:1784045585.766888:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873945600 00000100:00100000:2.0:1784045585.766920:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784045585.766928:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+22:17169:x1870706873945600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045585.767010:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+22:17169:x1870706873945600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045585.767017:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1784045585.768559:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb687dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784045585.768595:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784045585.777097:0:20270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784045585.778009:0:17169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784045585.778040:0:17169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784045585.778052:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454dc71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dc78 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045585.778064:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c93e79400/0x5475624df454dc71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dc78 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784045585.778075:0:17169:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784045585.778078:0:17169:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939c92653800 from 13 10000000:01000000:1.0:1784045585.778081:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784045585.778128:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93e79a00/0x5475624df454dc7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045585.778135:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939c93e79a00/0x5475624df454dc7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045585.778145:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939c93e79a00/0x5475624df454dc7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045585.778167:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784045585.778237:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045585.778682:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb687dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784045585.778800:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873945728 00000100:00100000:2.0:1784045585.778807:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873945728 00000100:00100000:2.0:1784045585.778851:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784045585.778859:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+22:17169:x1870706873945728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045585.778871:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045585.784109:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81986e00/0x5475624df454dc86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454dc7f expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045585.784163:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986e00/0x5475624df454dc86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454dc7f expref: 23 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045585.784177:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81986e00/0x5475624df454dc86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454dc7f expref: 23 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045585.784203:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986e00, rc 0) 00000100:00100000:2.0:1784045585.784323:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+23:17169:x1870706873945728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5462us (6084us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045585.784333:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784045585.784539:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784045585.784558:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939c93e79a00/0x5475624df454dc7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dc86 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045585.784580:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939c93e79a00/0x5475624df454dc7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454dc86 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045585.784656:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784045585.784690:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045585.784729:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb687dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784045585.784776:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873945856 00000100:00100000:0.0:1784045585.784784:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873945856 00000100:00100000:0.0:1784045585.784847:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784045585.784855:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+23:17169:x1870706873945856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045585.784990:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+23:17169:x1870706873945856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045585.784997:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784045585.785064:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b82379880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045585.785103:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045585.785144:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045585.785174:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc13466c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045585.785786:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873945984 00000100:00100000:2.0:1784045585.785793:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873945984 00000100:00100000:2.0:1784045585.785833:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784045585.785840:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+23:17169:x1870706873945984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045585.785954:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6abb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+23:17169:x1870706873945984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045585.785960:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784045585.786115:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873945984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784045585.787845:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1784045585.797212:0:17169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1784045585.797256:0:17169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784045585.797268:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939c93e79a00/0x5475624df454dc7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dc86 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045585.797281:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939c93e79a00/0x5475624df454dc7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dc86 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784045585.797292:0:17169:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784045585.797294:0:17169:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff939b840c4000 from 13 10000000:01000000:2.0:1784045585.797313:0:17169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784045585.797349:0:17169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987c00/0x5475624df454dc8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045585.797357:0:17169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.144@tcp lock: ffff939b81987c00/0x5475624df454dc8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045585.797369:0:17169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.144@tcp lock: ffff939b81987c00/0x5475624df454dc8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045585.797395:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b841c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873946112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784045585.797697:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045585.797741:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cc13469c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784045585.798199:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873946112 00000100:00100000:0.0:1784045585.798208:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873946112 00000100:00100000:0.0:1784045585.798283:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784045585.798294:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+23:17169:x1870706873946112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784045585.798310:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045585.798326:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939cc21fda00/0x5475624df454dc94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5475624df454dc8d expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045585.798353:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939cc21fda00/0x5475624df454dc94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5475624df454dc8d expref: 24 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045585.798372:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939cc21fda00/0x5475624df454dc94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5475624df454dc8d expref: 24 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045585.798381:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fda00, rc 0) 00000100:00100000:0.0:1784045585.798440:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6ab8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+24:17169:x1870706873946112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045585.798483:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784045585.798695:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b841c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873946112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784045585.798712:0:17169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.144@tcp lock: ffff939b81987c00/0x5475624df454dc8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dc94 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045585.798722:0:17169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.144@tcp lock: ffff939b81987c00/0x5475624df454dc8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5475624df454dc94 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045585.798787:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873946240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045585.798817:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045585.798849:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700600 going to sleep for 11 seconds 00000100:00100000:2.0:1784045585.799081:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873946240 00000100:00100000:2.0:1784045585.799086:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873946240 00000100:00100000:2.0:1784045585.799127:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784045585.799137:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+24:17169:x1870706873946240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784045585.799275:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c25407c2-0928-423d-881e-1585e6e3cc3c+24:17169:x1870706873946240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045585.799282:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784045585.799490:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873946240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045585.799524:0:17169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cb684b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873946368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045585.799568:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045585.799599:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873946368 00000100:00100000:0.0:1784045585.799603:0:17169:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c93a7a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045585.799605:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873946368 00000100:00100000:2.0:1784045585.799897:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784045585.799907:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+24:17169:x1870706873946368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784045585.800001:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+24:17169:x1870706873946368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045585.800008:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784045585.800078:0:17169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cb684b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c25407c2-0928-423d-881e-1585e6e3cc3c:17169:1870706873946368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784045585.804517:0:20273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1784045585.804596:0:17169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1784045585.804623:0:17169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784045585.804635:0:17169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.144@tcp lock: ffff939b81987c00/0x5475624df454dc8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dc94 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045585.804647:0:17169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.144@tcp lock: ffff939b81987c00/0x5475624df454dc8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5475624df454dc94 expref: -99 pid: 17169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784045585.942361:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784045585.985846:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045585.985935:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863370240 00000100:00100000:2.0:1784045585.985952:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863370240 00000100:00100000:2.0:1784045585.986006:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 159 00000100:00100000:2.0:1784045585.986016:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+11:14917:x1870706863370240:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045585.986032:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045585.986050:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81986200/0x5475624df454dc9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73f369 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045585.986080:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81986200/0x5475624df454dc9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f369 expref: 12 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045585.986090:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81986200/0x5475624df454dc9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f369 expref: 12 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045585.986099:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986200, rc 0) 00000100:00100000:2.0:1784045585.986154:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+12:14917:x1870706863370240:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 139us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045585.986161:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 159 00000100:00100000:3.0:1784045585.991855:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045585.991919:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863370368 00000100:00100000:2.0:1784045585.991935:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863370368 00000100:00100000:3.0:1784045585.992087:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 160 00000100:00100000:3.0:1784045585.992099:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+12:14917:x1870706863370368:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784045585.992279:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+12:14917:x1870706863370368:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 181us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045585.992287:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 160 00000100:00100000:2.0:1784045585.995859:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045585.996000:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863370496 00000100:00100000:3.0:1784045585.996013:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863370496 00000100:00100000:3.0:1784045585.996091:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 161 00000100:00100000:3.0:1784045585.996103:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+12:14917:x1870706863370496:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784045585.996312:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+12:14917:x1870706863370496:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 211us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045585.996329:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 161 00000100:00100000:3.0:1784045586.007496:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045586.009228:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863370624 00000100:00100000:2.0:1784045586.009248:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863370624 00000100:00100000:2.0:1784045586.009329:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 162 00000100:00100000:2.0:1784045586.009341:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+12:14917:x1870706863370624:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784045586.009360:0:17167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045586.009383:0:17167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff939b81987800/0x5475624df454dca2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x204809eba73f370 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045586.009419:0:17167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff939b81987800/0x5475624df454dca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f370 expref: 13 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045586.009485:0:17167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff939b81987800/0x5475624df454dca2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f370 expref: 13 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045586.009498:0:17167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987800, rc 0) 00000100:00100000:2.0:1784045586.009576:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+13:14917:x1870706863370624:12345-192.168.203.44@tcp:101:ll_cfg_requeue.0 Request processed in 237us (2098us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045586.009584:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 162 00000100:00100000:3.0:1784045586.014237:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045586.014310:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863370752 00000100:00100000:0.0:1784045586.014325:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863370752 00000100:00100000:0.0:1784045586.014399:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 163 00000100:00100000:0.0:1784045586.014410:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+13:14917:x1870706863370752:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784045586.014598:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+13:14917:x1870706863370752:12345-192.168.203.44@tcp:501:ll_cfg_requeue.0 Request processed in 188us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045586.014608:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 163 00000100:00100000:3.0:1784045586.031315:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045586.031403:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863370880 00000100:00100000:0.0:1784045586.031418:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863370880 00000100:00100000:0.0:1784045586.031525:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 164 00000100:00100000:0.0:1784045586.031535:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+13:14917:x1870706863370880:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784045586.031718:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0f86ebe-963e-4824-a274-0f8b57132670+13:14917:x1870706863370880:12345-192.168.203.44@tcp:503:ll_cfg_requeue.0 Request processed in 184us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045586.031727:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 164 00010000:00010000:2.0:1784045586.452639:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784045587.483260:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045587.716092:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045587.716304:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863371008 00000100:00100000:0.0:1784045587.716314:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863371008 00000100:00100000:0.0:1784045587.716396:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:0.0:1784045587.716406:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:15585:x1870706863371008:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045587.716426:0:18705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045587.716474:0:18705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454dca9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f377 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716542:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd400/0x5475624df454dcb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716556:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd400/0x5475624df454dcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716568:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd400/0x5475624df454dcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716583:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fde00/0x5475624df454dcb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716590:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fde00/0x5475624df454dcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716596:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fde00/0x5475624df454dcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716677:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd000/0x5475624df454dcbe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716700:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd000/0x5475624df454dcbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716707:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd000/0x5475624df454dcbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045587.716737:0:18705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784045587.716741:0:18705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784045587.716775:0:18705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd000/0x5475624df454dcbe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716786:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd400/0x5475624df454dcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716793:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd400/0x5475624df454dcb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716799:0:18705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd400/0x5475624df454dcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716806:0:18705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fd400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045587.716810:0:18705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd400/0x5475624df454dcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716817:0:18705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd400/0x5475624df454dcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716829:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:0.0:1784045587.716832:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045587.716837:0:18705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd400/0x5475624df454dcb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716853:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd400/0x5475624df454dcb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716868:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fde00/0x5475624df454dcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716874:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fde00/0x5475624df454dcb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716880:0:18705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fde00/0x5475624df454dcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716884:0:18705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc21fde00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045587.716887:0:18705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fde00/0x5475624df454dcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716893:0:18705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fde00/0x5475624df454dcb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716900:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff939c93cb7700) 00010000:00010000:0.0:1784045587.716903:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045587.716906:0:18705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fde00/0x5475624df454dcb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716912:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fde00/0x5475624df454dcb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716940:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd800/0x5475624df454dca9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f377 expref: 8 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716963:0:18705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd000/0x5475624df454dcbe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f377 expref: 7 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.716971:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff939c93cb7f00) 00010000:00010000:0.0:1784045587.716973:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784045587.716975:0:18705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc21fd000, rc 0) 00000100:00100000:0.0:1784045587.717038:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:15585:x1870706863371008:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 634us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045587.717045:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00080000:2.0:1784045587.717121:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784045587.722177:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045587.722306:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863371136 00000100:00100000:2.0:1784045587.722317:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863371136 00000100:00100000:2.0:1784045587.722389:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:2.0:1784045587.722399:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:15585:x1870706863371136:12345-192.168.203.44@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1784045587.722519:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:15585:x1870706863371136:12345-192.168.203.44@tcp:900:lhsmtool_posix.0 Request processed in 121us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045587.722528:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:3.0:1784045587.728966:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045587.729102:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863371392 00000100:00100000:1.0:1784045587.729111:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863371392 00000100:00100000:1.0:1784045587.729165:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:1.0:1784045587.729175:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:15585:x1870706863371392:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045587.729196:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045587.729228:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454dcc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f37e expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729305:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dccc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729338:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dccc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729351:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dccc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729396:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcd3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729404:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729412:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729549:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454dcda lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729558:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454dcda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729565:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454dcda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045587.729573:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1784045587.729716:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dccc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729724:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dccc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729731:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dccc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729742:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045587.729747:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dccc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729754:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dccc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729767:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff939c93cb7f00) 00010000:00010000:1.0:1784045587.729769:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045587.729774:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dccc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729781:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dccc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729796:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729802:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcd3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729807:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729812:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045587.729815:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729821:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcd3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729839:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff939c975b6900) 00010000:00010000:1.0:1784045587.729842:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045587.729844:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcd3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.729851:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcd3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.731868:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454dcc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f37e expref: 10 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.731904:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78800/0x5475624df454dcda lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f37e expref: 9 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.731914:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c975b6700) 00010000:00010000:1.0:1784045587.731918:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045587.731921:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93e78800, rc 0) 00000100:00100000:1.0:1784045587.732004:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+9:15585:x1870706863371392:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 2829us (3047us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1784045587.732014:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:0.0:1784045587.735158:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045587.735371:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863371520 00000100:00100000:2.0:1784045587.735382:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863371520 00000100:00100000:2.0:1784045587.735484:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:2.0:1784045587.735495:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb684b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+9:15585:x1870706863371520:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784045587.735596:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb684b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+9:15585:x1870706863371520:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 Request processed in 102us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045587.735604:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:3.0:1784045587.742607:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045587.742781:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863371648 00000100:00100000:0.0:1784045587.742791:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863371648 00000100:00080000:2.0:1784045587.742862:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784045587.742887:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:0.0:1784045587.742899:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:15585:x1870706863371648:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1784045587.744886:0:17173:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1942us 00000100:00100000:0.0:1784045587.786096:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:15585:x1870706863371648:12345-192.168.203.44@tcp:59:lhsmtool_posix.0 Request processed in 43189us (43488us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045587.786110:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 26 00000100:00100000:3.0:1784045587.801165:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045587.801348:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863371776 00000100:00100000:2.0:1784045587.801358:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863371776 00000100:00100000:2.0:1784045587.801417:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:2.0:1784045587.801425:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+9:15591:x1870706863371776:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045587.801483:0:18705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045587.801506:0:18705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dce8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f385 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801567:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dcef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801581:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dcef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801594:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dcef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801660:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dcf6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801668:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801675:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801724:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dcef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801732:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dcef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801755:0:18705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dcef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801762:0:18705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045587.801766:0:18705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dcef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801773:0:18705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dcef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801784:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:2.0:1784045587.801787:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045587.801791:0:18705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dcef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801797:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dcef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801809:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dcf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801815:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dcf6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801821:0:18705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dcf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801826:0:18705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81986a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045587.801828:0:18705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dcf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801842:0:18705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dcf6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801850:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff939b8310cc00) 00010000:00010000:2.0:1784045587.801852:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045587.801854:0:18705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dcf6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.801860:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dcf6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.802232:0:18705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dce8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f385 expref: 10 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.802244:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:2.0:1784045587.802246:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045587.802249:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dce8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f385 expref: 10 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.802258:0:18705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987600, rc 0) 00000100:00100000:2.0:1784045587.802319:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+9:15591:x1870706863371776:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 894us (1162us total) trans 0 rc 301/301 00000100:00100000:2.0:1784045587.802326:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:1.0:1784045587.806135:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045587.806256:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863371904 00000100:00100000:3.0:1784045587.806284:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863371904 00000100:00100000:3.0:1784045587.806337:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:3.0:1784045587.806348:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+9:15591:x1870706863371904:12345-192.168.203.44@tcp:700:lfs.0 00000100:00100000:3.0:1784045587.806423:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+9:15591:x1870706863371904:12345-192.168.203.44@tcp:700:lfs.0 Request processed in 77us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045587.806430:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:3.0:1784045587.817500:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045587.817997:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863372160 00000100:00100000:1.0:1784045587.818008:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863372160 00000100:00100000:1.0:1784045587.818077:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:1.0:1784045587.818087:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+9:15591:x1870706863372160:12345-192.168.203.44@tcp:36:lfs.0 00010000:00010000:1.0:1784045587.818140:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045587.818168:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b836ccc00/0x5475624df454dc16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f2f2 expref: 9 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.818206:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:1.0:1784045587.818221:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784045587.818286:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.818302:0:17172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454dc55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f362 expref: 5 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.818322:0:17172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.818359:0:17172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454dc55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f362 expref: 5 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.818372:0:17172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454dc55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f362 expref: 5 pid: 17174 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045587.818387:0:17172:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8237ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17172:1870706873946496:192.168.203.44@tcp:104: 00000100:00100000:1.0:1784045587.819040:0:17172:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fd083c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045587.822983:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045587.823152:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863372288 00000100:00100000:0.0:1784045587.823160:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863372288 00010000:00010000:0.0:1784045587.823228:0:17158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454dc55 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f362 expref: 6 pid: 17174 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045587.823272:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 15 00000100:00100000:0.0:1784045587.823281:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:2394:x1870706863372288:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045587.823306:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045587.823313:0:17158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454dc55 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f362 expref: 6 pid: 17174 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.823327:0:17158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454dc55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f362 expref: 6 pid: 17174 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.823347:0:17158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:0.0:1784045587.823352:0:17158:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.823362:0:17158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.823369:0:17158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045587.823385:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045587.823426:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:2394:x1870706863372288:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 146us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045587.823433:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 15 00010000:00010000:1.0:1784045587.823608:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc21fd600/0x5475624df454dc55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f362 expref: 5 pid: 17174 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045587.823629:0:17172:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8237ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17172:1870706873946496:192.168.203.44@tcp:104: 00010000:00010000:1.0:1784045587.823649:0:17172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.823657:0:17172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.823668:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.823689:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dd04 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.823698:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dd04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.823705:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dd04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784045587.824265:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784045587.832821:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454dd0b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.832844:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454dd0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.832856:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454dd0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045587.832872:0:17172:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb80ef68 reply state 0000000060a50193 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454dd0b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.832883:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454dd0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.832891:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939c975b6d00) 00010000:00010000:1.0:1784045587.832894:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784045587.832897:0:17172:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784045587.832902:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1784045587.832916:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.832923:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.832930:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.832936:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045587.832940:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.832946:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.832956:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:1.0:1784045587.832958:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045587.832961:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.832967:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dcfd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784045587.832984:0:17172:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb80ef68 reply state 0000000060a50193 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dd04 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.832992:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dd04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.832997:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff939c975b6900) 00010000:00010000:1.0:1784045587.832999:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784045587.833004:0:17172:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784045587.833101:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+10:15591:x1870706863372160:12345-192.168.203.44@tcp:36:lfs.0 Request processed in 15012us (15607us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1784045587.833110:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:2.0:1784045587.945602:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045587.945813:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863372416 00000100:00100000:1.0:1784045587.945823:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863372416 00000100:00100000:1.0:1784045587.945890:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:1.0:1784045587.945901:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+10:15599:x1870706863372416:12345-192.168.203.44@tcp:101:lctl.0 00010000:00010000:1.0:1784045587.945926:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045587.945953:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dd12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f38c expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.946022:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454dd19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.946036:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454dd19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.946049:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454dd19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045587.946096:0:17174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784045587.946112:0:17174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784045587.946148:0:17174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454dd19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.946173:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dd12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f38c expref: 12 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.946193:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78000/0x5475624df454dd19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f38c expref: 11 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.946233:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:1.0:1784045587.946237:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045587.946240:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c93e78000, rc 0) 00000100:00100000:1.0:1784045587.946301:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+11:15599:x1870706863372416:12345-192.168.203.44@tcp:101:lctl.0 Request processed in 402us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045587.946309:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:0.0:1784045587.972172:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045587.972491:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863372544 00000100:00100000:2.0:1784045587.972502:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863372544 00000100:00100000:2.0:1784045587.972583:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:2.0:1784045587.972593:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:15600:x1870706863372544:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045587.972611:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045587.972632:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dd20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f393 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.972695:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dd27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.972711:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dd27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.972722:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dd27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045587.972769:0:17173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784045587.972773:0:17173:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045587.972792:0:17173:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dd27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.972815:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dd20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f393 expref: 7 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.972832:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986a00/0x5475624df454dd27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f393 expref: 6 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045587.972840:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:2.0:1784045587.972843:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045587.972847:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81986a00, rc 0) 00000100:00100000:2.0:1784045587.973238:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:15600:x1870706863372544:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 645us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045587.973266:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:3.0:1784045587.979242:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045587.979344:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863372672 00000100:00100000:1.0:1784045587.979356:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863372672 00000100:00100000:1.0:1784045587.979418:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:1.0:1784045587.979429:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:15600:x1870706863372672:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:1.0:1784045587.979486:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045587.979509:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dd2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f39a expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979576:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454dd35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979591:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454dd35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979602:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454dd35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979634:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f000/0x5475624df454dd3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979643:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f000/0x5475624df454dd3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979661:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f000/0x5475624df454dd3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979743:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f800/0x5475624df454dd43 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979751:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f800/0x5475624df454dd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979757:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f800/0x5475624df454dd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045587.979795:0:17174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784045587.979799:0:17174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784045587.979817:0:17174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f800/0x5475624df454dd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979829:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454dd35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979835:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454dd35 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979841:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454dd35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979847:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045587.979851:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454dd35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979858:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454dd35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979888:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:1.0:1784045587.979891:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045587.979896:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454dd35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979902:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78e00/0x5475624df454dd35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979917:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f000/0x5475624df454dd3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979923:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f000/0x5475624df454dd3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979929:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f000/0x5475624df454dd3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979934:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c8fd5f000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045587.979937:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f000/0x5475624df454dd3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979942:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f000/0x5475624df454dd3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979949:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff939c975b6900) 00010000:00010000:1.0:1784045587.979952:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784045587.979955:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f000/0x5475624df454dd3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.979960:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f000/0x5475624df454dd3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.980879:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78400/0x5475624df454dd2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f39a expref: 8 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.980897:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f800/0x5475624df454dd43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f39a expref: 7 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045587.980905:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939c975b6d00) 00010000:00010000:1.0:1784045587.980907:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784045587.980909:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c8fd5f800, rc 0) 00000100:00100000:1.0:1784045587.981345:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+7:15600:x1870706863372672:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1914us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045587.981355:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 31 00000100:00100000:3.0:1784045587.983793:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045587.983891:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863372800 00000100:00100000:2.0:1784045587.983900:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863372800 00000100:00100000:2.0:1784045587.984030:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:2.0:1784045587.984040:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:15600:x1870706863372800:12345-192.168.203.44@tcp:900:lfs.0 00000100:00100000:2.0:1784045587.984131:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:15600:x1870706863372800:12345-192.168.203.44@tcp:900:lfs.0 Request processed in 92us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045587.984139:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:2.0:1784045587.989186:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045587.989281:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863373056 00000100:00100000:3.0:1784045587.989291:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863373056 00000100:00100000:3.0:1784045587.989348:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 32 00000100:00100000:3.0:1784045587.989358:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+7:15600:x1870706863373056:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045587.989377:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045587.989399:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e000/0x5475624df454dd4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3a1 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045587.989540:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784045587.989643:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e000/0x5475624df454dd4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3a1 expref: 9 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.989657:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:3.0:1784045587.989660:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045587.989665:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e000/0x5475624df454dd4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3a1 expref: 9 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.989679:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106e000, rc 0) 00000100:00100000:3.0:1784045587.989734:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+8:15600:x1870706863373056:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 377us (557us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1784045587.989741:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 32 00000100:00100000:1.0:1784045587.993004:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045587.993110:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863373312 00000100:00100000:3.0:1784045587.993120:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863373312 00000100:00100000:3.0:1784045587.993179:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:3.0:1784045587.993189:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8237ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+8:15600:x1870706863373312:12345-192.168.203.44@tcp:36:lfs.0 00000100:00080000:0.0:1784045587.993202:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1784045587.993252:0:18705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045587.993281:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5f800/0x5475624df454dd43 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f39a expref: 8 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.993299:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939c975b6d00) 00010000:00010000:3.0:1784045587.993304:0:18705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045587.993326:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f400/0x5475624df454dd58 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.993358:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f400/0x5475624df454dd58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.993367:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f400/0x5475624df454dd58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784045587.993594:0:18705:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005a3c95c0 reply state 000000002bc1b43b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f400/0x5475624df454dd58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.993607:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f400/0x5475624df454dd58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.993613:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939c975b6d00) 00010000:00010000:3.0:1784045587.993616:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1784045587.993619:0:18705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784045587.993626:0:18705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1784045587.993687:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8237ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+9:15600:x1870706863373312:12345-192.168.203.44@tcp:36:lfs.0 Request processed in 500us (691us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1784045587.993693:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 33 00000100:00100000:3.0:1784045587.995605:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000040:00080000:2.0:1784045587.995746:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784045587.995858:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863373568 00000100:00100000:1.0:1784045587.995866:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863373568 00000100:00100000:1.0:1784045587.995955:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:1.0:1784045587.995965:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+9:15600:x1870706863373568:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:1.0:1784045587.996188:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+10:15600:x1870706863373568:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 224us (590us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1784045587.996196:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:0.0:1784045587.998876:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045587.998952:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863373824 00000100:00100000:3.0:1784045587.998962:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863373824 00000100:00100000:3.0:1784045587.999071:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:3.0:1784045587.999081:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+10:15600:x1870706863373824:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:3.0:1784045587.999103:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045587.999123:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fa00/0x5475624df454dd5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3a8 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999192:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454dd66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999231:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454dd66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999243:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454dd66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999255:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454dd6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999261:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454dd6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999267:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454dd6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045587.999381:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784045587.999505:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454dd66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999514:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454dd66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999521:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454dd66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999527:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106fe00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045587.999532:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454dd66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999538:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454dd66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999563:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:3.0:1784045587.999566:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045587.999571:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454dd66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999578:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454dd66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999592:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454dd6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999598:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454dd6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999603:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454dd6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999608:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106f600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045587.999611:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454dd6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999617:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454dd6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999624:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff939c975b6900) 00010000:00010000:3.0:1784045587.999627:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045587.999630:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454dd6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999635:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454dd6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999681:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fa00/0x5475624df454dd5f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3a8 expref: 12 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999692:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:3.0:1784045587.999694:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784045587.999697:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fa00/0x5475624df454dd5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3a8 expref: 12 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045587.999706:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106fa00, rc 0) 00000100:00100000:3.0:1784045587.999777:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+11:15600:x1870706863373824:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 697us (911us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1784045587.999785:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 34 00000100:00100000:3.0:1784045588.007637:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045588.009130:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863373952 00000100:00100000:2.0:1784045588.009151:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863373952 00000100:00100000:2.0:1784045588.009262:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:2.0:1784045588.009275:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+11:15600:x1870706863373952:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045588.009306:0:18705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045588.009338:0:18705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dd7b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3af expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.009740:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987400/0x5475624df454dd82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.009758:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987400/0x5475624df454dd82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.009774:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987400/0x5475624df454dd82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045588.009806:0:18705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784045588.009828:0:18705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045588.009855:0:18705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987400/0x5475624df454dd82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.010115:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dd7b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3af expref: 13 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.010137:0:18705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987400/0x5475624df454dd82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3af expref: 12 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.010146:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939c975b6d00) 00010000:00010000:2.0:1784045588.010150:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784045588.010154:0:18705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939b81987400, rc 0) 00000100:00100000:2.0:1784045588.010251:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+12:15600:x1870706863373952:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 978us (2817us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.010260:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 35 00000100:00100000:0.0:1784045588.022061:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045588.022150:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863374080 00000100:00100000:2.0:1784045588.022161:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863374080 00000100:00100000:2.0:1784045588.022222:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:2.0:1784045588.022232:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+12:15600:x1870706863374080:12345-192.168.203.44@tcp:37:lfs.0 00000100:00100000:1.0:1784045588.030680:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+12:15600:x1870706863374080:12345-192.168.203.44@tcp:37:lfs.0 Request processed in 8435us (8614us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045588.030696:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 3 00000100:00100000:3.0:1784045588.041623:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045588.041771:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863374336 00000100:00100000:1.0:1784045588.041782:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863374336 00000100:00100000:1.0:1784045588.041858:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 4 00000100:00100000:1.0:1784045588.041874:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1257850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+12:15600:x1870706863374336:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:1.0:1784045588.042104:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1257850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+13:15600:x1870706863374336:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 236us (490us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1784045588.042112:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 4 00000040:00080000:3.0:1784045588.052441:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1784045588.116416:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784045588.116458:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873946624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784045588.116552:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045588.116899:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045588.116911:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873946752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045588.116942:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784045588.116972:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873946624 00000100:00100000:1.0:1784045588.116980:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873946624 00000100:00100000:1.0:1784045588.117027:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873946752 00000100:00100000:1.0:1784045588.117030:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873946752 00000100:00100000:1.0:1784045588.117050:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784045588.117058:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873946624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784045588.117087:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784045588.117131:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873946624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045588.117137:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784045588.117158:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784045588.117164:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873946752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784045588.117176:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1784045588.117201:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873946752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045588.117219:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784045588.117258:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf4cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873946752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045588.117301:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873946624:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784045588.117476:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045588.117649:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873947136:0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.117691:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045588.117709:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873947648:0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.117729:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045588.117744:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873948160:0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.117778:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045588.117796:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1784045588.117801:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873947008:0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.117823:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045588.117837:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873947520:0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.117865:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045588.117883:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873948032:0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.117901:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045588.117926:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873947136 00000100:00100000:3.0:1784045588.117930:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873947136 00000100:00100000:3.0:1784045588.117965:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873947520 00000100:00100000:3.0:1784045588.117968:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873947520 00000100:00100000:3.0:1784045588.117987:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784045588.117993:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873947136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.118031:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873947136:12345-0@lo:400:kworker.0 Request processed in 37us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045588.118036:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784045588.118049:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784045588.118055:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873947520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.118079:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873947520:12345-0@lo:400:kworker.0 Request processed in 26us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045588.118084:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1784045588.118097:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784045588.118114:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873947520:0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.118124:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873947136:0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.118144:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873947648 00000100:00100000:3.0:1784045588.118147:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873947648 00000100:00100000:3.0:1784045588.118167:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873948160 00000100:00100000:3.0:1784045588.118170:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873948160 00000100:00100000:3.0:1784045588.118187:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873948032 00000100:00100000:3.0:1784045588.118189:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873948032 00000100:00100000:3.0:1784045588.118201:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784045588.118225:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873947648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.118271:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1870706873947648:12345-0@lo:400:kworker.0 Request processed in 38us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045588.118278:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784045588.118290:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784045588.118296:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873948160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.118322:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1870706873948160:12345-0@lo:400:kworker.0 Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045588.118327:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784045588.118337:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784045588.118343:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873948032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.118366:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1870706873948032:12345-0@lo:400:kworker.0 Request processed in 24us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045588.118371:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1784045588.118384:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784045588.118386:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784045588.118401:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1870706873948032:0@lo:400:kworker.0 00000100:00100000:3.0:1784045588.118412:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1870706873947648:0@lo:400:kworker.0 00010000:00080000:3.0:1784045588.118422:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c812aca80 x1870706873948160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045588.118432:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1870706873948160:0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.120702:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873947264:0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.120781:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045588.120822:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873947776:0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.120842:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045588.120894:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1784045588.120901:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b823bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873946880:0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.120929:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045588.120963:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873947392:0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.120987:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045588.121006:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873947904:0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.121025:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045588.121062:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873946880 00000100:00100000:2.0:1784045588.121069:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873946880 00000100:00100000:2.0:1784045588.121111:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784045588.121119:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+24:3625:x1870706873946880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.121167:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c25407c2-0928-423d-881e-1585e6e3cc3c+24:3625:x1870706873946880:12345-0@lo:400:kworker.0 Request processed in 48us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.121173:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784045588.121202:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873947008 00000100:00100000:2.0:1784045588.121215:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873947008 00000100:00100000:2.0:1784045588.121239:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873947392 00000100:00100000:2.0:1784045588.121242:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873947392 00000100:00100000:2.0:1784045588.121256:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784045588.121261:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873947008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.121313:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873947008:12345-0@lo:400:kworker.0 Request processed in 51us (3489us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.121320:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784045588.121332:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784045588.121338:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873947392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.121366:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873947392:12345-0@lo:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.121378:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784045588.121420:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873947008:0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.121482:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b823bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c25407c2-0928-423d-881e-1585e6e3cc3c:3625:1870706873946880:0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.121491:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873947392:0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.121522:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873947264 00000100:00100000:2.0:1784045588.121526:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873947264 00000100:00100000:2.0:1784045588.121544:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873947776 00000100:00100000:2.0:1784045588.121547:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873947776 00000100:00100000:2.0:1784045588.121562:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873947904 00000100:00100000:2.0:1784045588.121565:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873947904 00000100:00100000:2.0:1784045588.121577:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784045588.121583:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873947264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.121616:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1870706873947264:12345-0@lo:400:kworker.0 Request processed in 33us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.121622:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784045588.121633:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784045588.121639:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873947776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.121660:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1870706873947776:12345-0@lo:400:kworker.0 Request processed in 22us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.121664:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784045588.121673:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784045588.121677:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873947904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.121697:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1870706873947904:12345-0@lo:400:kworker.0 Request processed in 20us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.121701:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1784045588.121734:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939c812af480 x1870706873947904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784045588.121744:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1870706873947904:0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.121754:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1870706873947264:0@lo:400:kworker.0 00000100:00100000:2.0:1784045588.121761:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1870706873947776:0@lo:400:kworker.0 00000100:00080000:3.0:1784045588.122606:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784045588.122613:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045588.170164:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045588.170400:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863374464 00000100:00100000:2.0:1784045588.170410:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863374464 00000100:00100000:2.0:1784045588.170516:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:2.0:1784045588.170526:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+11:15606:x1870706863374464:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:2.0:1784045588.170546:0:18705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045588.170568:0:18705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dd89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3b6 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.170949:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dd90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.170966:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dd90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.170978:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dd90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.170989:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987e00/0x5475624df454dd97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.170997:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987e00/0x5475624df454dd97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171004:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987e00/0x5475624df454dd97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171108:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454dd9e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171117:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454dd9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171124:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454dd9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045588.171159:0:18705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784045588.171163:0:18705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045588.171198:0:18705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454dd9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171219:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dd90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171226:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dd90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171233:0:18705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dd90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171238:0:18705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045588.171242:0:18705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dd90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171249:0:18705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dd90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171260:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:2.0:1784045588.171268:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045588.171272:0:18705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dd90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171279:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987600/0x5475624df454dd90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171292:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987e00/0x5475624df454dd97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171298:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987e00/0x5475624df454dd97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171304:0:18705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987e00/0x5475624df454dd97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171309:0:18705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939b81987e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045588.171311:0:18705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987e00/0x5475624df454dd97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171317:0:18705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987e00/0x5475624df454dd97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171323:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff939c975b6900) 00010000:00010000:2.0:1784045588.171325:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045588.171328:0:18705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987e00/0x5475624df454dd97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171333:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987e00/0x5475624df454dd97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171356:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81986c00/0x5475624df454dd89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3b6 expref: 13 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171378:0:18705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030e00/0x5475624df454dd9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3b6 expref: 12 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.171385:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939c975b6d00) 00010000:00010000:2.0:1784045588.171388:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784045588.171390:0:18705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030e00, rc 0) 00000100:00100000:2.0:1784045588.171857:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+12:15606:x1870706863374464:12345-192.168.203.44@tcp:101:bash.0 Request processed in 1330us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.171866:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 36 00000100:00100000:2.0:1784045588.176265:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045588.176363:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863374592 00000100:00100000:0.0:1784045588.176373:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863374592 00000100:00100000:0.0:1784045588.176499:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:0.0:1784045588.176525:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b823bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:15606:x1870706863374592:12345-192.168.203.44@tcp:900:bash.0 00000100:00100000:0.0:1784045588.176608:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b823bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:15606:x1870706863374592:12345-192.168.203.44@tcp:900:bash.0 Request processed in 85us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045588.176616:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:0.0:1784045588.181335:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045588.181468:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863374848 00000100:00100000:3.0:1784045588.181553:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863374848 00000100:00100000:3.0:1784045588.181660:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 37 00000100:00100000:3.0:1784045588.181672:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+12:15606:x1870706863374848:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:3.0:1784045588.181695:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045588.181718:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fa00/0x5475624df454dda5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3bd expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.181842:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.181857:0:17173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987400/0x5475624df454dd82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3af expref: 12 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.181877:0:17173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.181913:0:17173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987400/0x5475624df454dd82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3af expref: 12 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.181927:0:17173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987400/0x5475624df454dd82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3af expref: 12 pid: 18705 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045588.181940:0:17173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812af800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17173:1870706873948288:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045588.182075:0:17173:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c83883b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784045588.185424:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045588.185841:0:17173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812af800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17173:1870706873948288:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045588.185878:0:17173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045588.186339:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863374976 00000100:00100000:2.0:1784045588.186347:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863374976 00010000:00010000:2.0:1784045588.186383:0:17927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987400/0x5475624df454dd82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3af expref: 13 pid: 18705 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045588.186494:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 16 00000100:00100000:2.0:1784045588.186502:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+13:2395:x1870706863374976:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045588.186516:0:17927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045588.186522:0:17927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987400/0x5475624df454dd82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3af expref: 13 pid: 18705 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.186534:0:17927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987400/0x5475624df454dd82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3af expref: 13 pid: 18705 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.186554:0:17927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939b81987400/0x5475624df454dd82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3af expref: 13 pid: 18705 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.186589:0:17927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939c975b6d00) 00010000:00010000:2.0:1784045588.186594:0:17927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.186604:0:17927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.186612:0:17927:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.186632:0:17927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045588.186682:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+12:2395:x1870706863374976:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 181us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.186689:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 16 00010000:00010000:0.0:1784045588.186743:0:17173:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.186750:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.186773:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa200/0x5475624df454ddb3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.186784:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa200/0x5475624df454ddb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.186792:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa200/0x5475624df454ddb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.187289:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa800/0x5475624df454ddba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.187300:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa800/0x5475624df454ddba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.187308:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa800/0x5475624df454ddba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045588.187319:0:17173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784045588.187344:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.187358:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.187365:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.187371:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106f600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045588.187375:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.187382:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.187392:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939c975b6d00) 00010000:00010000:0.0:1784045588.187395:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045588.187400:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.187406:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f600/0x5475624df454ddac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045588.187417:0:17173:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ffc3113e reply state 0000000044f5aceb transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa200/0x5475624df454ddb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.187428:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa200/0x5475624df454ddb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.187433:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff939c93cb7700) 00010000:00010000:0.0:1784045588.187436:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784045588.187438:0:17173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784045588.187514:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fa00/0x5475624df454dda5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3bd expref: 15 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.187534:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa800/0x5475624df454ddba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3bd expref: 14 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.187542:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:0.0:1784045588.187544:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1784045588.187546:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aa800, rc 0) 00000100:00100000:0.0:1784045588.187583:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+15:15606:x1870706863374848:12345-192.168.203.44@tcp:101:bash.0 Request processed in 5915us (6258us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1784045588.187590:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 37 00000100:00100000:2.0:1784045588.198994:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045588.199142:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863375104 00000100:00100000:0.0:1784045588.199153:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863375104 00000100:00100000:0.0:1784045588.199223:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:0.0:1784045588.199233:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+15:15606:x1870706863375104:12345-192.168.203.44@tcp:101:bash.0 00010000:00010000:0.0:1784045588.199256:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045588.199277:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454ddc8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3c4 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.199346:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454ddcf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.199359:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454ddcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.199370:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454ddcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045588.199422:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1784045588.199439:0:17172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784045588.199644:0:17172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454ddcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.199658:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454ddcf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.199689:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454ddc8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3c4 expref: 17 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.199710:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454ddcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3c4 expref: 16 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.199719:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:0.0:1784045588.199722:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045588.199726:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aac00, rc 0) 00000100:00100000:0.0:1784045588.199889:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+16:15606:x1870706863375104:12345-192.168.203.44@tcp:101:bash.0 Request processed in 656us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045588.199897:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 38 00000100:00100000:1.0:1784045588.203605:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045588.203733:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863375360 00000100:00100000:0.0:1784045588.203742:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863375360 00000100:00100000:0.0:1784045588.203838:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:0.0:1784045588.203849:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+16:15606:x1870706863375360:12345-192.168.203.44@tcp:35:bash.0 00000100:00100000:0.0:1784045588.204214:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+17:15606:x1870706863375360:12345-192.168.203.44@tcp:35:bash.0 Request processed in 357us (607us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1784045588.204222:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 5 00000100:00100000:1.0:1784045588.320271:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045588.320623:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863375616 00000100:00100000:2.0:1784045588.320634:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863375616 00000100:00100000:2.0:1784045588.320710:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:2.0:1784045588.320721:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+17:15616:x1870706863375616:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045588.320755:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045588.320774:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454ddd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3cb expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045588.320866:0:17174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1784045588.320967:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454ddd6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3cb expref: 19 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.321013:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff939c975b6a00) 00010000:00010000:2.0:1784045588.321015:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045588.321021:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454ddd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3cb expref: 19 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.321396:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030000, rc 0) 00000100:00100000:2.0:1784045588.321527:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+18:15616:x1870706863375616:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 807us (1266us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1784045588.321535:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 39 00000100:00100000:1.0:1784045588.325720:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045588.326429:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863375872 00000100:00100000:2.0:1784045588.326438:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863375872 00000100:00100000:2.0:1784045588.326595:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:2.0:1784045588.326607:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+18:15616:x1870706863375872:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:2.0:1784045588.326943:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82a8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+19:15616:x1870706863375872:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 337us (1231us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1784045588.326951:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 6 00000100:00100000:1.0:1784045588.414244:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045588.414363:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863376128 00000100:00100000:2.0:1784045588.414374:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863376128 00000100:00100000:2.0:1784045588.414491:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:2.0:1784045588.414503:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b82883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+19:15619:x1870706863376128:12345-192.168.203.44@tcp:101:lfs.0 00010000:00010000:2.0:1784045588.414528:0:18705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045588.414549:0:18705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454dde4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3d2 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.415424:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454ddeb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.415542:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454ddeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.415556:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454ddeb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784045588.415572:0:18705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784045588.415900:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454dde4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3d2 expref: 22 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.415922:0:18705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454ddeb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3d2 expref: 21 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.415931:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:3.0:1784045588.415934:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784045588.415938:0:18705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106fe00, rc 0) 00000100:00100000:3.0:1784045588.416419:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b82883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+21:15619:x1870706863376128:12345-192.168.203.44@tcp:101:lfs.0 Request processed in 1915us (2182us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1784045588.416428:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 40 00000100:00100000:1.0:1784045588.421955:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045588.422261:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045588.422413:0:20204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863376384 00000100:00100000:2.0:1784045588.422436:0:20204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863376384 00000100:00100000:2.0:1784045588.422549:0:20204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:2.0:1784045588.422559:0:20204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+21:2396:x1870706863376384:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045588.422574:0:20204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045588.422599:0:20204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fe00/0x5475624df454ddeb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3d2 expref: 21 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.422616:0:20204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:2.0:1784045588.422621:0:20204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045588.422673:0:20204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+20:2396:x1870706863376384:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 115us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.422681:0:20204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:0.0:1784045588.424333:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863376256 00000100:00100000:0.0:1784045588.424345:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863376256 00000100:00100000:0.0:1784045588.424460:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:0.0:1784045588.424494:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+20:15619:x1870706863376256:12345-192.168.203.44@tcp:54:lfs.0 00010000:00010000:0.0:1784045588.424566:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454ddf9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.424582:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454ddf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.424594:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454ddf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.424634:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454ddf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.424640:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454ddf9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.424647:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454ddf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.424652:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915ab200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045588.424667:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454ddf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.424675:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454ddf9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.424686:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:0.0:1784045588.424690:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784045588.424693:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454ddf9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.424700:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454ddf9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045588.424778:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+20:15619:x1870706863376256:12345-192.168.203.44@tcp:54:lfs.0 Request processed in 286us (2836us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045588.424786:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 41 00000100:00100000:1.0:1784045588.427280:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045588.427514:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863376640 00000100:00100000:3.0:1784045588.427524:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863376640 00000100:00100000:3.0:1784045588.427574:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 7 00000100:00100000:3.0:1784045588.427584:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+20:15619:x1870706863376640:12345-192.168.203.44@tcp:35:lfs.0 00000100:00100000:3.0:1784045588.427836:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+21:15619:x1870706863376640:12345-192.168.203.44@tcp:35:lfs.0 Request processed in 252us (564us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1784045588.427844:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 7 00010000:00010000:2.0:1784045588.503702:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045588.671375:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045588.671418:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045588.671500:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045588.671535:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045588.671564:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045588.671573:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863377024 00000100:00100000:1.0:1784045588.671583:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863377280 00000100:00100000:0.0:1784045588.671583:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863377024 00000100:00100000:1.0:1784045588.671586:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863377280 00000100:00100000:2.0:1784045588.671647:0:19104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863376896 00000100:00100000:2.0:1784045588.671651:0:19104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863376896 00000100:00100000:3.0:1784045588.671702:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863376768 00000100:00100000:3.0:1784045588.671721:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863376768 00000100:00100000:3.0:1784045588.671778:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 166 00000100:00100000:3.0:1784045588.671787:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+13:2395:x1870706863376768:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045588.671849:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0f86ebe-963e-4824-a274-0f8b57132670+13:2395:x1870706863376768:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 63us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045588.671857:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 166 00000100:00100000:3.0:1784045588.671907:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863377152 00000100:00100000:3.0:1784045588.671911:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863377152 00000100:00100000:1.0:1784045588.671965:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:2.0:1784045588.679352:0:19104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:2.0:1784045588.679368:0:19104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2395:x1870706863376896:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045588.679460:0:19104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2395:x1870706863376896:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 82us (7909us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.679469:0:19104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00080000:2.0:1784045588.679530:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784045588.679537:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784045588.680195:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2395:x1870706863377280:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:1.0:1784045588.680307:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2395:x1870706863377280:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 8334us (8805us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045588.680316:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:3.0:1784045588.685604:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:3.0:1784045588.685618:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2395:x1870706863377152:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045588.685695:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2395:x1870706863377152:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 81us (14130us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045588.685703:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 23 00000100:00100000:0.0:1784045588.687389:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:0.0:1784045588.687404:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2395:x1870706863377024:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:0.0:1784045588.687493:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2395:x1870706863377024:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 93us (16074us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045588.687501:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:2.0:1784045588.716345:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045588.716573:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863377536 00000100:00100000:0.0:1784045588.716583:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863377536 00000100:00100000:0.0:1784045588.716651:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:0.0:1784045588.716661:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+21:15650:x1870706863377536:12345-192.168.203.44@tcp:101:cat.0 00010000:00010000:0.0:1784045588.716686:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045588.716709:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454de00 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3d9 expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.716845:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454de07 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.716926:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454de07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.716940:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454de07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784045588.716964:0:17172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784045588.717147:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454de00 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3d9 expref: 24 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.717166:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454de07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3d9 expref: 23 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.717173:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:0.0:1784045588.717176:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045588.717179:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915ab400, rc 0) 00000100:00100000:0.0:1784045588.717363:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+23:15650:x1870706863377536:12345-192.168.203.44@tcp:101:cat.0 Request processed in 702us (1026us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1784045588.717371:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 42 00000100:00100000:1.0:1784045588.722317:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045588.722960:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045588.723222:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863377792 00000100:00100000:3.0:1784045588.723232:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863377792 00000100:00100000:3.0:1784045588.723290:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:3.0:1784045588.723300:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+23:15650:x1870706863377792:12345-192.168.203.44@tcp:35:cat.0 00000100:00100000:3.0:1784045588.723683:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+24:15650:x1870706863377792:12345-192.168.203.44@tcp:35:cat.0 Request processed in 383us (1375us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1784045588.723692:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 8 00000100:00100000:0.0:1784045588.725408:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863377920 00000100:00100000:0.0:1784045588.725421:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863377920 00000100:00100000:2.0:1784045588.727100:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:2.0:1784045588.727119:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+24:2397:x1870706863377920:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784045588.727136:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045588.727183:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab400/0x5475624df454de07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3d9 expref: 24 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.727213:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:2.0:1784045588.727218:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045588.727287:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+23:2397:x1870706863377920:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 176us (4329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.727295:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:1.0:1784045588.785410:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045588.785489:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863378176 00000100:00100000:2.0:1784045588.785499:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863378176 00000100:00100000:2.0:1784045588.785567:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:2.0:1784045588.785578:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+23:15656:x1870706863378176:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:2.0:1784045588.785603:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045588.785627:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454de15 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3e0 expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.785746:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030a00/0x5475624df454de1c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.785759:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa800/0x5475624df454ddba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3bd expref: 24 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.785767:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454ddcf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3c4 expref: 24 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.785774:0:17174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030a00/0x5475624df454de1c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.785804:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454ddcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3c4 expref: 24 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.785830:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454ddcf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3c4 expref: 24 pid: 17172 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045588.785844:0:17174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88337800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17174:1870706873948416:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045588.786051:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa800/0x5475624df454ddba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3bd expref: 24 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.786060:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa800/0x5475624df454ddba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3bd expref: 24 pid: 17173 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045588.786070:0:17174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c88337480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17174:1870706873948544:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045588.786109:0:17174:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb6915480 going to sleep for 11 seconds 00000100:00100000:1.0:1784045588.789869:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045588.789909:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045588.789978:0:20204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863378304 00000100:00100000:0.0:1784045588.789987:0:20204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863378304 00000100:00100000:3.0:1784045588.790000:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863378432 00000100:00100000:3.0:1784045588.790004:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863378432 00010000:00010000:0.0:1784045588.790028:0:20204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454ddcf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3c4 expref: 26 pid: 17172 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.790038:0:17927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa800/0x5475624df454ddba lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3bd expref: 26 pid: 17173 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045588.790068:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 17 00000100:00100000:3.0:1784045588.790143:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b834c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+26:2396:x1870706863378432:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045588.790160:0:17927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045588.790167:0:17927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa800/0x5475624df454ddba lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3bd expref: 26 pid: 17173 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.790178:0:17927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa800/0x5475624df454ddba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3bd expref: 26 pid: 17173 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.790199:0:17927:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:3.0:1784045588.790213:0:17927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030a00/0x5475624df454de1c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.790222:0:17927:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030a00/0x5475624df454de1c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.790228:0:17927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045588.790278:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b834c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+26:2396:x1870706863378432:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 137us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.790789:0:17174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88337800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17174:1870706873948416:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045588.790804:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa800/0x5475624df454ddba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3bd expref: 26 pid: 17173 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045588.790822:0:17174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c88337480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17174:1870706873948544:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045588.790849:0:17174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030a00/0x5475624df454de1c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045588.792375:0:20204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 18 00000100:00100000:0.0:1784045588.792395:0:20204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+25:2396:x1870706863378304:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045588.792417:0:20204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045588.792426:0:20204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454ddcf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3c4 expref: 25 pid: 17172 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.792489:0:20204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454ddcf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3c4 expref: 25 pid: 17172 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.792510:0:20204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454ddcf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3c4 expref: 25 pid: 17172 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.792525:0:20204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:0.0:1784045588.792530:0:20204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030a00/0x5475624df454de1c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.792538:0:20204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030a00/0x5475624df454de1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.792546:0:20204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030a00/0x5475624df454de1c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045588.792558:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 17 00010000:00010000:0.0:1784045588.792578:0:20204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045588.792622:0:20204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+23:2396:x1870706863378304:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 235us (2770us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045588.792629:0:20204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 18 00010000:00010000:2.0:1784045588.793843:0:17174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030a00/0x5475624df454de1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.793855:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030a00/0x5475624df454de1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045588.793895:0:17174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784045588.794930:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454de15 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3e0 expref: 24 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.794954:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030a00/0x5475624df454de1c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3e0 expref: 23 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.794962:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:2.0:1784045588.795157:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784045588.795162:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030a00, rc 0) 00000100:00100000:2.0:1784045588.795241:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+23:15656:x1870706863378176:12345-192.168.203.44@tcp:101:dd.0 Request processed in 9663us (9839us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1784045588.795251:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 43 00000100:00100000:2.0:1784045588.797599:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045588.797803:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863378560 00000100:00100000:3.0:1784045588.797811:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863378560 00000100:00100000:3.0:1784045588.797860:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:3.0:1784045588.797870:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+23:15656:x1870706863378560:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:3.0:1784045588.797895:0:18705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045588.797915:0:18705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e000/0x5475624df454de2a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3e7 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.798124:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f000/0x5475624df454de31 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.798156:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f000/0x5475624df454de31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.798169:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f000/0x5475624df454de31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.798295:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e000/0x5475624df454de2a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3e7 expref: 25 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.798313:0:18705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f000/0x5475624df454de31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3e7 expref: 24 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045588.798321:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:3.0:1784045588.798324:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784045588.798328:0:18705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106f000, rc 0) 00000100:00100000:3.0:1784045588.798681:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+24:15656:x1870706863378560:12345-192.168.203.44@tcp:101:dd.0 Request processed in 810us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045588.798689:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 44 00000100:00100000:1.0:1784045588.812291:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045588.813090:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863378816 00000100:00100000:0.0:1784045588.813103:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863378816 00000100:00100000:0.0:1784045588.813246:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 45 00000100:00100000:0.0:1784045588.813258:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+24:15656:x1870706863378816:12345-192.168.203.44@tcp:36:dd.0 00010000:00010000:0.0:1784045588.813852:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454de38 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.813871:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454de38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.813904:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454de38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784045588.813952:0:17173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1784045588.813983:0:17173:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ffac9ed2 reply state 00000000a0979d72 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454de38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.813995:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454de38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.814004:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:0.0:1784045588.814007:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784045588.814011:0:17173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045588.814111:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+27:15656:x1870706863378816:12345-192.168.203.44@tcp:36:dd.0 Request processed in 854us (1829us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1784045588.814119:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 45 00000020:00080000:0.0:1784045588.814124:0:17173:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784045588.826967:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045588.827236:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863378944 00000100:00100000:0.0:1784045588.827247:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863378944 00000100:00100000:0.0:1784045588.827327:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:0.0:1784045588.827338:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+27:15656:x1870706863378944:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:0.0:1784045588.827360:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045588.827381:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454de3f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3ee expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.827486:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454de3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3ee expref: 28 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.827503:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454de3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3ee expref: 28 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045588.827534:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:0.0:1784045588.827538:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784045588.827541:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915ab200, rc 0) 00000100:00100000:1.0:1784045588.827832:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83381f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+28:15656:x1870706863378944:12345-192.168.203.44@tcp:101:dd.0 Request processed in 494us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045588.827841:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 46 00000100:00100000:3.0:1784045588.852126:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045588.852418:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863379200 00000100:00100000:2.0:1784045588.852430:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863379200 00000100:00100000:2.0:1784045588.852546:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:2.0:1784045588.852558:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+28:15656:x1870706863379200:12345-192.168.203.44@tcp:103:dd.0 00010000:00010000:2.0:1784045588.852573:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784045588.852598:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab200/0x5475624df454de3f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3ee expref: 28 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.852617:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:2.0:1784045588.852621:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784045588.852873:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+27:15656:x1870706863379200:12345-192.168.203.44@tcp:103:dd.0 Request processed in 317us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.852898:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 2 00000100:00100000:2.0:1784045588.855778:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045588.855919:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863379328 00000100:00100000:1.0:1784045588.855929:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863379328 00000100:00100000:1.0:1784045588.855989:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:1.0:1784045588.855998:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+27:15656:x1870706863379328:12345-192.168.203.44@tcp:58:dd.0 00010000:00010000:1.0:1784045588.856103:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5ea00/0x5475624df454de46 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045588.856120:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5ea00/0x5475624df454de46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045588.856132:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5ea00/0x5475624df454de46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784045588.864007:0:17174:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784045588.864405:0:17174:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1784045588.864819:0:17174:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1784045588.864933:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+27:15656:x1870706863379328:12345-192.168.203.44@tcp:58:dd.0 Request processed in 8931us (9158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045588.864945:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 47 00000100:00100000:1.0:1784045588.872774:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045588.872905:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863379456 00000100:00100000:2.0:1784045588.872916:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863379456 00000100:00100000:2.0:1784045588.872984:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 48 00000100:00100000:2.0:1784045588.872993:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b83382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+27:15656:x1870706863379456:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:2.0:1784045588.873014:0:18705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045588.873034:0:18705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454de4d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3f5 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.873092:0:18705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5ea00/0x5475624df454de46 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.873105:0:18705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454de4d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3f5 expref: 28 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.873124:0:18705:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5ea00/0x5475624df454de46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.873137:0:18705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454de4d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3f5 expref: 28 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.873150:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:2.0:1784045588.873153:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045588.873157:0:18705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454de4d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3f5 expref: 28 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045588.873176:0:18705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80031000, rc 0) 00000100:00100000:2.0:1784045588.873267:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b83382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+28:15656:x1870706863379456:12345-192.168.203.44@tcp:101:dd.0 Request processed in 274us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045588.873274:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 48 00000040:00080000:3.0:1784045589.076077:0:17206:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784045589.076088:0:17206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784045589.076114:0:17206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784045589.076124:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1784045589.076266:0:17206:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17206:1870706873948672:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784045589.076375:0:17206:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c83883b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784045589.083033:0:17206:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ad880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17206:1870706873948672:192.168.203.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784045589.083972:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045589.084863:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863379584 00000100:00100000:3.0:1784045589.084892:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863379584 00000100:00100000:3.0:1784045589.085044:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 49 00000100:00080000:2.0:1784045589.085046:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784045589.085057:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c91563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+28:15657:x1870706863379584:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784045589.085091:0:17173:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784045589.085219:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c91563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+28:15657:x1870706863379584:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 166us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045589.085227:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 49 00000100:00100000:1.0:1784045589.091950:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045589.097955:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863379712 00000100:00100000:2.0:1784045589.097970:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863379712 00000100:00100000:2.0:1784045589.098043:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:2.0:1784045589.098055:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+28:15657:x1870706863379712:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784045589.098292:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454de54 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098310:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454de54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098325:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454de54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098343:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454de5b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098350:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454de5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098356:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454de5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098380:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454de62 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098390:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454de62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098417:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454de62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045589.098641:0:18705:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784045589.098645:0:18705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784045589.098661:0:18705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454de62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098673:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454de54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098680:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454de54 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098688:0:18705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454de54 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098694:0:18705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045589.098698:0:18705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454de54 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098707:0:18705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454de54 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098719:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c975b6700) 00010000:00010000:2.0:1784045589.098722:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045589.098727:0:18705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454de54 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098733:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454de54 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098757:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454de5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098763:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454de5b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098768:0:18705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454de5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.098774:0:18705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030000 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045589.098777:0:18705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454de5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.099623:0:18705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454de5b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.099636:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff939b8310cc00) 00010000:00010000:2.0:1784045589.099640:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045589.099643:0:18705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454de5b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.099650:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454de5b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.099672:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454de62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.099678:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454de62 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.099684:0:18705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454de62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.099699:0:18705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045589.099702:0:18705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454de62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.099708:0:18705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454de62 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.099717:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:2.0:1784045589.099720:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045589.099722:0:18705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454de62 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.099727:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031c00/0x5475624df454de62 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045589.100658:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+28:15657:x1870706863379712:12345-192.168.203.44@tcp:34:lhsmtool_posix.0 Request processed in 2598us (8709us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045589.100671:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 50 00000100:00100000:2.0:1784045589.103247:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045589.104170:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863379968 00000100:00100000:1.0:1784045589.104181:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863379968 00000100:00100000:2.0:1784045589.104372:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:2.0:1784045589.104383:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+28:15657:x1870706863379968:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045589.104404:0:17174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045589.104424:0:17174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454de69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f3fc expref: -99 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.104559:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454de70 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.104594:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454de70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.104606:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454de70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784045589.104617:0:17174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784045589.104699:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454de70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.104707:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454de70 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.104725:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454de70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.104731:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045589.104735:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454de70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.104742:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454de70 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.104754:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:2.0:1784045589.104757:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784045589.104762:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454de70 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.104769:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454de70 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.104819:0:17174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454de69 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3fc expref: 30 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.104836:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff939c975b6700) 00010000:00010000:2.0:1784045589.104838:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784045589.104842:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454de69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3fc expref: 30 pid: 17174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.104852:0:17174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030c00, rc 0) 00000100:00100000:2.0:1784045589.105038:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+29:15657:x1870706863379968:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 656us (1798us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1784045589.105046:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 51 00000100:00100000:0.0:1784045589.110090:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045589.110333:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863380096 00000100:00100000:2.0:1784045589.110344:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863380096 00000100:00100000:2.0:1784045589.110410:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:2.0:1784045589.110420:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+29:15657:x1870706863380096:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784045589.110492:0:17174:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784045589.110606:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+29:15657:x1870706863380096:12345-192.168.203.44@tcp:53:lhsmtool_posix.0 Request processed in 186us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045589.110613:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 52 00000100:00100000:0.0:1784045589.114359:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045589.115004:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863380352 00000100:00100000:3.0:1784045589.115013:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863380352 00000100:00100000:3.0:1784045589.115076:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:3.0:1784045589.115086:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b841c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+29:15657:x1870706863380352:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045589.115106:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045589.115260:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e000/0x5475624df454de7e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f403 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784045589.116943:0:17173:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:0.0:1784045589.116958:0:17173:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1784045589.117081:0:17173:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1784045589.118081:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454de85 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.118099:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454de85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.118111:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454de85 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.118388:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e000/0x5475624df454de7e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f403 expref: 32 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.118412:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454de85 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f403 expref: 31 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.118422:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939c93cb7b00) 00010000:00010000:0.0:1784045589.118425:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784045589.118428:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aaa00, rc 0) 00000100:00100000:0.0:1784045589.119908:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b841c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+31:15657:x1870706863380352:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 4814us (5547us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1784045589.119935:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 53 00000100:00100000:0.0:1784045589.129705:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045589.130079:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863380608 00000100:00100000:3.0:1784045589.130088:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863380608 00000100:00100000:3.0:1784045589.130604:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:3.0:1784045589.130617:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+31:15657:x1870706863380608:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784045589.130676:0:18705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045589.130702:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aaa00/0x5475624df454de85 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f403 expref: 31 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.130720:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939c93cb7b00) 00010000:00010000:3.0:1784045589.130730:0:18705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784045589.130752:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e200/0x5475624df454de93 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131587:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e200/0x5475624df454de93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131603:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e200/0x5475624df454de93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131624:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fc00/0x5475624df454de9a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2e411e9a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131633:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fc00/0x5475624df454de9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e411e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131639:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fc00/0x5475624df454de9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e411e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131685:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e200/0x5475624df454de93 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131692:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e200/0x5475624df454de93 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131698:0:18705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e200/0x5475624df454de93 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131704:0:18705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106e200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045589.131708:0:18705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e200/0x5475624df454de93 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131714:0:18705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e200/0x5475624df454de93 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131721:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939c975b6d00) 00010000:00010000:3.0:1784045589.131731:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045589.131736:0:18705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e200/0x5475624df454de93 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131742:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e200/0x5475624df454de93 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131752:0:18705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fc00/0x5475624df454de9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e411e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131758:0:18705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fc00/0x5475624df454de9a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e411e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131764:0:18705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fc00/0x5475624df454de9a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e411e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131769:0:18705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106fc00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:3.0:1784045589.131771:0:18705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fc00/0x5475624df454de9a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e411e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.131776:0:18705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fc00/0x5475624df454de9a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2e411e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.132337:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x2e411e9a (ffff939c93a84500) 00010000:00010000:3.0:1784045589.132340:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784045589.132345:0:18705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fc00/0x5475624df454de9a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2e411e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.132351:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106fc00/0x5475624df454de9a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2e411e9a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045589.132684:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+30:15657:x1870706863380608:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 2067us (2984us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784045589.132693:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 54 00000100:00100000:2.0:1784045589.135427:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045589.136087:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863380736 00000100:00100000:1.0:1784045589.136098:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863380736 00000100:00100000:0.0:1784045589.136725:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:0.0:1784045589.136736:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+30:15657:x1870706863380736:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045589.136755:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045589.136777:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454dea1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f40a expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.136826:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454dea8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.136839:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454dea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.136851:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454dea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.136970:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aae00/0x5475624df454dea1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f40a expref: 32 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.136991:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915abe00/0x5475624df454dea8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f40a expref: 31 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.137000:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939c93cb7e00) 00010000:00010000:0.0:1784045589.137008:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784045589.137012:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915abe00, rc 0) 00000100:00100000:0.0:1784045589.137076:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+31:15657:x1870706863380736:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 341us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045589.137083:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 55 00000100:00100000:1.0:1784045589.140409:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045589.140731:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863380992 00000100:00100000:2.0:1784045589.140741:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863380992 00000100:00100000:2.0:1784045589.140810:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:2.0:1784045589.140821:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+31:15657:x1870706863380992:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784045589.140912:0:17173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454deaf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.140946:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454deaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.140960:0:17173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454deaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784045589.141137:0:17173:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1784045589.141146:0:17173:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 545249701024ns, next at 546249698933ns, rc = 0 00000004:00010000:2.0:1784045589.141355:0:17173:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000721a4333 reply state 00000000702646e9 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454deaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.141368:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454deaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.141375:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939c93cb7e00) 00010000:00010000:2.0:1784045589.141378:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1784045589.141382:0:17173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784045589.141566:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+33:15657:x1870706863380992:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 745us (1164us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1784045589.141574:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 56 00000100:00100000:1.0:1784045589.146620:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045589.146720:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863381120 00000100:00100000:2.0:1784045589.146729:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863381120 00000100:00100000:2.0:1784045589.146937:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:2.0:1784045589.146947:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+33:15657:x1870706863381120:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784045589.146969:0:17173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784045589.146989:0:17173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454deb6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f411 expref: -99 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.147059:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454deb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f411 expref: 34 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.147074:0:17173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454deb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f411 expref: 34 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.147093:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939c93cb7e00) 00010000:00010000:2.0:1784045589.147096:0:17173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045589.147100:0:17173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c80030000, rc 0) 00000100:00100000:2.0:1784045589.147287:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+34:15657:x1870706863381120:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 340us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045589.147295:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 57 00000100:00100000:2.0:1784045589.152137:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045589.152239:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863381248 00000100:00100000:1.0:1784045589.152250:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863381248 00000100:00100000:1.0:1784045589.152308:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:1.0:1784045589.152318:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2397:x1870706863381248:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784045589.152608:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2397:x1870706863381248:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 291us (489us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1784045589.152617:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 24 00000100:00100000:0.0:1784045589.156971:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045589.157108:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863381504 00000100:00100000:3.0:1784045589.157145:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863381504 00000100:00100000:3.0:1784045589.157317:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:3.0:1784045589.157328:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+34:15657:x1870706863381504:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784045589.157777:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc13b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+35:15657:x1870706863381504:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 449us (815us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1784045589.157793:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 9 00000100:00100000:0.0:1784045589.161340:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045589.161440:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863381760 00000100:00100000:3.0:1784045589.161574:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863381760 00000100:00100000:0.0:1784045589.161745:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:0.0:1784045589.161755:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+35:15657:x1870706863381760:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784045589.162057:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+35:15657:x1870706863381760:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 302us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045589.162064:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 58 00000100:00100000:2.0:1784045589.164591:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045589.164682:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863381888 00000100:00100000:1.0:1784045589.164691:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863381888 00000100:00100000:1.0:1784045589.164749:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:1.0:1784045589.164759:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c88336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+35:15657:x1870706863381888:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784045589.164787:0:18705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784045589.164808:0:18705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5e800/0x5475624df454debd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f418 expref: -99 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.170715:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5e400/0x5475624df454dec4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.170742:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5e400/0x5475624df454dec4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.170758:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5e400/0x5475624df454dec4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784045589.170824:0:18705:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784045589.170847:0:18705:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5e400/0x5475624df454dec4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.170895:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5e800/0x5475624df454debd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f418 expref: 37 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.170926:0:18705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5e400/0x5475624df454dec4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f418 expref: 36 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.170935:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939c93cb7e00) 00010000:00010000:1.0:1784045589.170938:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784045589.170941:0:18705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c8fd5e400, rc 0) 00000100:00100000:1.0:1784045589.171593:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c88336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+36:15657:x1870706863381888:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 6830us (7005us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045589.171603:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 59 00000100:00100000:2.0:1784045589.176061:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045589.176411:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863382016 00000100:00100000:0.0:1784045589.176422:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863382016 00000100:00100000:0.0:1784045589.176520:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:0.0:1784045589.176531:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2394:x1870706863382016:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784045589.176549:0:18683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784045589.176571:0:18683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023984446/0x5475624df454decb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f41f expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784045589.176595:0:18683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a566014, blocks: 0x0 00010000:00010000:0.0:1784045589.176613:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1784045589.176618:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045589.176626:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023984446/0x5475624df454decb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f41f expref: 7 pid: 18683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.176668:0:18683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023984446/0x5475624df454decb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f41f expref: 7 pid: 18683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.176680:0:18683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939c915aae00, rc 0) 00000100:00100000:0.0:1784045589.178731:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:2394:x1870706863382016:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 2190us (2666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045589.178745:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 25 00000100:00100000:2.0:1784045589.183114:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045589.183334:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863382272 00000100:00100000:3.0:1784045589.183343:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863382272 00000100:00100000:2.0:1784045589.183707:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:2.0:1784045589.183720:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+36:15657:x1870706863382272:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784045589.183973:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+36:15657:x1870706863382272:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 255us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045589.183981:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 60 00000100:00100000:1.0:1784045589.190712:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045589.191720:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863382400 00000100:00100000:0.0:1784045589.191731:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863382400 00000100:00100000:0.0:1784045589.191803:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:0.0:1784045589.191815:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+36:15657:x1870706863382400:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1784045589.194395:0:17152:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1784045589.194411:0:17152:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1784045589.194470:0:17152:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1784045589.194606:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f400/0x5475624df454dd58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.194623:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f400/0x5475624df454dd58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.194630:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f400/0x5475624df454dd58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.194636:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939cc106f400 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:1.0:1784045589.194641:0:3609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f400/0x5475624df454dd58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.194648:0:3609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f400/0x5475624df454dd58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.194680:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939c975b6d00) 00010000:00010000:1.0:1784045589.194683:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1784045589.194688:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f400/0x5475624df454dd58 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.194693:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f400/0x5475624df454dd58 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045589.194718:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045589.194734:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873948800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784045589.194807:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784045589.195291:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dd04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195301:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dd04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195307:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dd04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195312:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e78600 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045589.195316:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dd04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195323:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dd04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195345:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff939c975b6900) 00010000:00010000:0.0:1784045589.195348:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045589.195351:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dd04 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195357:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e78600/0x5475624df454dd04 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195385:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454dd0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195392:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454dd0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195398:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454dd0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195404:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c93e79200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045589.195406:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454dd0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195412:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454dd0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195420:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff939c975b6d00) 00010000:00010000:0.0:1784045589.195422:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045589.195425:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454dd0b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195430:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c93e79200/0x5475624df454dd0b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195485:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa200/0x5475624df454ddb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195492:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa200/0x5475624df454ddb3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195498:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa200/0x5475624df454ddb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195503:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aa200 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045589.195506:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa200/0x5475624df454ddb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195513:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa200/0x5475624df454ddb3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195521:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff939c93cb7700) 00010000:00010000:0.0:1784045589.195524:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045589.195527:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa200/0x5475624df454ddb3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195533:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa200/0x5475624df454ddb3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195547:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454de38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195554:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454de38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195559:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454de38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195569:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aac00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045589.195572:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454de38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195578:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454de38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195587:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:0.0:1784045589.195589:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784045589.195592:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454de38 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195598:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aac00/0x5475624df454de38 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195610:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454deaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195617:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454deaf lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195623:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454deaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195628:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:0.0:1784045589.195631:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454deaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195637:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454deaf lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195654:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939c93cb7e00) 00010000:00010000:0.0:1784045589.195656:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784045589.195659:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454deaf lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.195666:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454deaf lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045589.195972:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+15:15657:x1870706863382400:12345-192.168.203.44@tcp:44:lhsmtool_posix.0 Request processed in 4156us (5264us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045589.195982:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 61 00000100:00100000:2.0:1784045589.196105:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873948800 00000100:00100000:2.0:1784045589.196112:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873948800 00000100:00100000:2.0:1784045589.196329:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784045589.196340:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873948800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1784045589.196539:0:18682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784045589.196542:0:18682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1784045589.196544:0:18682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784045589.196546:0:18682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1784045588 -> 1784045588 00002000:00010000:2.0:1784045589.196549:0:18682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1784045589.196610:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1870706873948800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 274us (1803us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1784045589.196617:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:2.0:1784045589.196662:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff939b836d0700/2, rc 0, transno 8589934596 00000100:00100000:2.0:1784045589.196669:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873948800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784045589.201778:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045589.201988:0:19104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863382528 00000100:00100000:3.0:1784045589.201997:0:19104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863382528 00000100:00100000:3.0:1784045589.202056:0:19104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:3.0:1784045589.202066:0:19104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:2395:x1870706863382528:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784045589.202208:0:19104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:2395:x1870706863382528:12345-192.168.203.44@tcp:16:lhsmtool_posix.0 Request processed in 134us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045589.202216:0:19104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:3.0:1784045589.204824:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045589.205165:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863382784 00000100:00100000:0.0:1784045589.205175:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863382784 00000100:00100000:0.0:1784045589.205240:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:0.0:1784045589.205250:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+15:15657:x1870706863382784:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784045589.205302:0:18705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045589.205329:0:18705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5e400/0x5475624df454dec4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f418 expref: 15 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.205349:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939c93cb7e00) 00010000:00010000:0.0:1784045589.205354:0:18705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784045589.205394:0:18705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab800/0x5475624df454ded2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.205408:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab800/0x5475624df454ded2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.205418:0:18705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab800/0x5475624df454ded2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784045589.205588:0:18705:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b5bfbe1b reply state 00000000513bd361 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab800/0x5475624df454ded2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.205601:0:18705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915ab800/0x5475624df454ded2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.205607:0:18705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939c93cb7e00) 00010000:00010000:0.0:1784045589.205610:0:18705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784045589.205612:0:18705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784045589.205702:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+16:15657:x1870706863382784:12345-192.168.203.44@tcp:36:lhsmtool_posix.0 Request processed in 452us (885us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1784045589.205709:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 62 00000100:00100000:0.0:1784045589.210042:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045589.210759:0:18683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863382912 00000100:00100000:3.0:1784045589.210770:0:18683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863382912 00000100:00100000:3.0:1784045589.210843:0:18683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:3.0:1784045589.210853:0:18683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:15657:x1870706863382912:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784045589.210878:0:18683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045589.210898:0:18683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454ded9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f426 expref: -99 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.210932:0:18683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023984446/0x5475624df454decb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f41f expref: 8 pid: 18683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.210956:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045589.210960:0:18683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784045589.210966:0:18683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454ded9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f426 expref: 8 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.211011:0:18683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023984446/0x5475624df454decb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f41f expref: 8 pid: 18683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.211024:0:18683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023984446/0x5475624df454decb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f41f expref: 8 pid: 18683 timeout: 645 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045589.211037:0:18683:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18683:1870706873948928:192.168.203.44@tcp:104: 00000100:00100000:3.0:1784045589.211115:0:18683:0:(client.c:2702:ptlrpc_set_wait()) set ffff939b83700000 going to sleep for 11 seconds 00000100:00100000:0.0:1784045589.215280:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045589.215480:0:18683:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:18683:1870706873948928:192.168.203.44@tcp:104: 00010000:00010000:3.0:1784045589.215514:0:18683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454ded9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f426 expref: 8 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.215536:0:18683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106fc00, rc 0) 00000100:00100000:3.0:1784045589.215595:0:18683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+8:15657:x1870706863382912:12345-192.168.203.44@tcp:101:lhsmtool_posix.0 Request processed in 4743us (5563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045589.215604:0:18683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:1.0:1784045589.217679:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863383040 00000100:00100000:1.0:1784045589.217693:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863383040 00010000:00010000:1.0:1784045589.217741:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023984446/0x5475624df454decb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f41f expref: 8 pid: 18683 timeout: 645 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045589.217795:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:1.0:1784045589.217805:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81999880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+8:2395:x1870706863383040:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784045589.217821:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784045589.217846:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023984446/0x5475624df454decb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f41f expref: 8 pid: 18683 timeout: 645 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.217871:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023984446/0x5475624df454decb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f41f expref: 8 pid: 18683 timeout: 645 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.217898:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023984446/0x5475624df454decb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f41f expref: 8 pid: 18683 timeout: 645 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.217930:0:17159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045589.217935:0:17159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784045589.217942:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454ded9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f426 expref: 7 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.217954:0:17159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454ded9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f426 expref: 7 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784045589.218114:0:17159:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454ded9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f426 expref: 7 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045589.218129:0:17159:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b836d1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17159:1870706873949056:192.168.203.44@tcp:105: 00000100:00100000:1.0:1784045589.218348:0:17159:0:(client.c:2702:ptlrpc_set_wait()) set ffff939c8fd08540 going to sleep for 11 seconds 00000100:00100000:0.0:1784045589.223348:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045589.223686:0:17159:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b836d1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17159:1870706873949056:192.168.203.44@tcp:105: 00010000:00010000:1.0:1784045589.223708:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784045589.223761:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81999880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:2395:x1870706863383040:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 5957us (8489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784045589.223772:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 19 00000100:00100000:2.0:1784045589.225139:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863383168 00000100:00100000:2.0:1784045589.225160:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863383168 00000100:00100000:2.0:1784045589.225224:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:2.0:1784045589.225234:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:2395:x1870706863383168:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784045589.225396:0:18681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784045589.225400:0:18681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1784045588 00002000:00010000:2.0:1784045589.225402:0:18681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1784045587 00002000:00010000:2.0:1784045589.225403:0:18681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1784045588 -> 1784045588 00002000:00010000:2.0:1784045589.225406:0:18681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1784045589.225487:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+8:2395:x1870706863383168:12345-192.168.203.44@tcp:2:lhsmtool_posix.0 Request processed in 254us (2147us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1784045589.225494:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:0.0:1784045589.234755:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045589.235063:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863383296 00000100:00100000:2.0:1784045589.235075:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863383296 00000100:00100000:2.0:1784045589.235253:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:2.0:1784045589.235278:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+8:2395:x1870706863383296:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784045589.235326:0:19969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.235347:0:19969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454ded9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.44@tcp remote: 0x204809eba73f426 expref: 8 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.235356:0:19969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045589.235360:0:19969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784045589.235365:0:19969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.235400:0:19969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454ded9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f426 expref: 8 pid: 18683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.235415:0:19969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454ded9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f426 expref: 8 pid: 18683 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045589.235430:0:19969:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19969:1870706873949184:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045589.235744:0:19969:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb6915000 going to sleep for 11 seconds 00000100:00100000:1.0:1784045589.241065:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045589.241722:0:17927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863383424 00000100:00100000:3.0:1784045589.241732:0:17927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863383424 00010000:00010000:3.0:1784045589.241797:0:17927:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454ded9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f426 expref: 9 pid: 18683 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045589.241844:0:17927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 20 00000100:00100000:3.0:1784045589.241853:0:17927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+9:2395:x1870706863383424:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045589.241989:0:17927:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045589.242014:0:17927:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454ded9 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f426 expref: 9 pid: 18683 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.242030:0:17927:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454ded9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f426 expref: 9 pid: 18683 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.242055:0:17927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045589.242060:0:17927:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784045589.242066:0:17927:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.242076:0:17927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.242098:0:17927:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045589.242282:0:17927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5c4ec1df-89f5-44e3-9b84-9820a7989c32+9:2395:x1870706863383424:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 427us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045589.242290:0:17927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 20 00010000:00010000:2.0:1784045589.243664:0:19969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000a40d53/0x5475624df454ded9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.44@tcp remote: 0x204809eba73f426 expref: 8 pid: 18683 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045589.243690:0:19969:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19969:1870706873949184:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045589.243715:0:19969:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.243743:0:19969:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.243750:0:19969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.243776:0:19969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.243955:0:19969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.243965:0:19969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.244045:0:19969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030c00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045589.244051:0:19969:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.244061:0:19969:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.244081:0:19969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.244099:0:19969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f927ed05/0x5475624df454dee0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045589.244376:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+7:2395:x1870706863383296:12345-192.168.203.44@tcp:1:lhsmtool_posix.0 Request processed in 9098us (9628us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045589.244386:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:1.0:1784045589.247307:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045589.247412:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863383680 00000100:00100000:2.0:1784045589.247423:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863383680 00000100:00100000:2.0:1784045589.247645:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 63 00000100:00100000:2.0:1784045589.247656:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+16:15657:x1870706863383680:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784045589.247757:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.247774:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f000/0x5475624df454de31 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3e7 expref: 16 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.247796:0:17174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.247831:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f000/0x5475624df454de31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3e7 expref: 16 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.247845:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f000/0x5475624df454de31 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3e7 expref: 16 pid: 18705 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045589.247870:0:17174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17174:1870706873949312:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045589.247968:0:17174:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb6915000 going to sleep for 11 seconds 00000100:00100000:1.0:1784045589.251324:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045589.251399:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863383808 00000100:00100000:3.0:1784045589.251407:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863383808 00010000:00010000:3.0:1784045589.251476:0:17157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f000/0x5475624df454de31 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3e7 expref: 17 pid: 18705 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784045589.251531:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 21 00000100:00100000:3.0:1784045589.251541:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+17:2394:x1870706863383808:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784045589.251572:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784045589.251580:0:17157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f000/0x5475624df454de31 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3e7 expref: 17 pid: 18705 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.251592:0:17157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f000/0x5475624df454de31 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3e7 expref: 17 pid: 18705 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.251613:0:17157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:3.0:1784045589.251619:0:17157:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454de4d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3f5 expref: 17 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.251628:0:17157:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.251636:0:17157:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.251644:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.251663:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784045589.251720:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+17:2394:x1870706863383808:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 180us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045589.251728:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 21 00010000:00010000:2.0:1784045589.253178:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f000/0x5475624df454de31 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f3e7 expref: 16 pid: 18705 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045589.253214:0:17174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17174:1870706873949312:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045589.253240:0:17174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.253251:0:17174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.253255:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.253538:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.253553:0:17174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454deb6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f411 expref: 16 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.253562:0:17174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.253596:0:17174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454deb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f411 expref: 16 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.253612:0:17174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454deb6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f411 expref: 16 pid: 17173 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045589.253627:0:17174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17174:1870706873949440:192.168.203.44@tcp:104: 00000100:00100000:2.0:1784045589.253786:0:17174:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb6915b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784045589.257287:0:17174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17174:1870706873949440:192.168.203.44@tcp:104: 00010000:00010000:2.0:1784045589.257316:0:17174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045589.258252:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045589.258342:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863383936 00000100:00100000:0.0:1784045589.258350:0:17159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863383936 00010000:00010000:0.0:1784045589.258389:0:17159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454deb6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f411 expref: 17 pid: 17173 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784045589.258434:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 22 00000100:00100000:0.0:1784045589.258480:0:17159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+17:2394:x1870706863383936:12345-192.168.203.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784045589.258495:0:17159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784045589.258501:0:17159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454deb6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f411 expref: 17 pid: 17173 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.258532:0:17159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454deb6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f411 expref: 17 pid: 17173 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.258555:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030000/0x5475624df454deb6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.44@tcp remote: 0x204809eba73f411 expref: 17 pid: 17173 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.258572:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939c93cb7e00) 00010000:00010000:0.0:1784045589.258577:0:17159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.258587:0:17159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.258593:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.258618:0:17159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784045589.258670:0:17159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+16:2394:x1870706863383936:12345-192.168.203.44@tcp:103:ldlm_bl.0 Request processed in 227us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045589.258679:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 22 00010000:00010000:2.0:1784045589.258772:0:17174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.258788:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784045589.258898:0:17174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1784045589.259025:0:17174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1784045589.259064:0:17174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1784045589.259138:0:17174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17174:1870706873949568:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784045589.259185:0:17174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045589.259231:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873949568 00000100:00100000:2.0:1784045589.259236:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873949568 00000100:00100000:2.0:1784045589.259266:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784045589.259272:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17174:x1870706873949568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784045589.259338:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17174:x1870706873949568:12345-0@lo:1000:mdt00_002.0 Request processed in 66us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045589.259346:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784045589.259368:0:17174:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb6915900 going to sleep for 11 seconds 00000100:00100000:2.0:1784045589.259390:0:17174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17174:1870706873949568:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1784045589.259551:0:17174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1784045589.259589:0:17174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17174:1870706873949696:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784045589.259616:0:17174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784045589.259659:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873949696 00000100:00100000:2.0:1784045589.259663:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873949696 00000100:00100000:2.0:1784045589.259686:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784045589.259693:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17174:x1870706873949696:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784045589.259792:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17174:x1870706873949696:12345-0@lo:1000:mdt00_002.0 Request processed in 99us (174us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1784045589.259798:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784045589.259814:0:17174:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb69159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784045589.259828:0:17174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17174:1870706873949696:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1784045589.259852:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.259861:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.259868:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.259875:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031e00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045589.259878:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.259886:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.259899:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939c93cb7e00) 00010000:00010000:2.0:1784045589.259902:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045589.259906:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.259913:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031e00/0x5475624df454deee lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.259952:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5ea00/0x5475624df454de46 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.259958:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5ea00/0x5475624df454de46 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.259963:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5ea00/0x5475624df454de46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.259966:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c8fd5ea00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045589.259969:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5ea00/0x5475624df454de46 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.259974:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5ea00/0x5475624df454de46 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.259981:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:2.0:1784045589.259983:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784045589.259989:0:17174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454de4d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3f5 expref: 19 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.259998:0:17174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454de4d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3f5 expref: 19 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.260006:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454de4d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3f5 expref: 19 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.260051:0:17174:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031000/0x5475624df454de4d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f3f5 expref: 19 pid: 18705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045589.260070:0:17174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b831f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17174:1870706873949824:192.168.203.44@tcp:105: 00000100:00100000:2.0:1784045589.260113:0:17174:0:(client.c:2702:ptlrpc_set_wait()) set ffff939cb6915180 going to sleep for 11 seconds 00000100:00100000:1.0:1784045589.268687:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045589.268902:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863384064 00000100:00100000:3.0:1784045589.268927:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863384064 00000100:00100000:3.0:1784045589.269002:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:3.0:1784045589.269012:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cc1256050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+20:15656:x1870706863384064:12345-192.168.203.44@tcp:49:dd.0 00000100:00100000:3.0:1784045589.269156:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cc1256050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+20:15656:x1870706863384064:12345-192.168.203.44@tcp:49:dd.0 Request processed in 145us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045589.269164:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 10 00000100:00100000:2.0:1784045589.270094:0:17174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b831f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17174:1870706873949824:192.168.203.44@tcp:105: 00010000:00010000:2.0:1784045589.270123:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5ea00/0x5475624df454de46 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270134:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c8fd5ea00/0x5475624df454de46 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270168:0:17174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454def5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270182:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454def5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270194:0:17174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454def5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270215:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454def5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270222:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454def5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270228:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454def5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270235:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80030c00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045589.270239:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454def5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270258:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454def5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270271:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:2.0:1784045589.270274:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784045589.270278:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454def5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270284:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80030c00/0x5475624df454def5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270296:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270302:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270308:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270313:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031a00 already unused, calling callback (ffffffffc19d14f0) 00010000:00010000:2.0:1784045589.270315:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270321:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270328:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:2.0:1784045589.270331:0:17174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784045589.270334:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.270350:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c80031a00/0x5475624df454dee7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045589.270958:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5c4ec1df-89f5-44e3-9b84-9820a7989c32+19:15657:x1870706863383680:12345-192.168.203.44@tcp:57:lhsmtool_posix.0 Request processed in 23300us (23655us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1784045589.270968:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 63 00000020:00080000:2.0:1784045589.270974:0:17174:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784045589.271192:0:17206:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784045589.271197:0:17206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784045589.271231:0:17206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784045589.271239:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1784045589.281587:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:1.0:1784045589.281656:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:3.0:1784045589.281767:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863384192 00000100:00100000:3.0:1784045589.281788:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863384192 00000100:00100000:3.0:1784045589.281867:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:3.0:1784045589.281878:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b836d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+19:15656:x1870706863384192:12345-192.168.203.44@tcp:101:dd.0 00010000:00010000:3.0:1784045589.281898:0:17172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784045589.281919:0:17172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e200/0x5475624df454defc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x204809eba73f42d expref: -99 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.281955:0:17172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f800/0x5475624df454df03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.281983:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f800/0x5475624df454df03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.281994:0:17172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f800/0x5475624df454df03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.282107:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106e200/0x5475624df454defc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f42d expref: 21 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.282710:0:17172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff939cc106f800/0x5475624df454df03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.44@tcp remote: 0x204809eba73f42d expref: 20 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.282719:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff939c93cb7900) 00010000:00010000:3.0:1784045589.282722:0:17172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784045589.282726:0:17172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff939cc106f800, rc 0) 00000100:00100000:3.0:1784045589.282804:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b836d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5c4ec1df-89f5-44e3-9b84-9820a7989c32+20:15656:x1870706863384192:12345-192.168.203.44@tcp:101:dd.0 Request processed in 927us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045589.282813:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 64 00000100:00100000:0.0:1784045589.290295:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863384448 00000100:00100000:0.0:1784045589.290310:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863384448 00000100:00100000:0.0:1784045589.290389:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 11 00000100:00100000:0.0:1784045589.290401:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+20:15657:x1870706863384448:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784045589.290727:0:17176:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784045589.290764:0:17176:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1784045589.291101:0:17176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa400/0x5475624df454df0a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.291127:0:17176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa400/0x5475624df454df0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.291139:0:17176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa400/0x5475624df454df0a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.291148:0:17176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa400/0x5475624df454df0a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.291155:0:17176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa400/0x5475624df454df0a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.291161:0:17176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa400/0x5475624df454df0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.291185:0:17176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784045589.291284:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf553800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+22:15657:x1870706863384448:12345-192.168.203.44@tcp:35:lhsmtool_posix.0 Request processed in 885us (9625us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1784045589.291293:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 11 00000020:00080000:0.0:1784045589.291299:0:17176:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784045589.291382:0:19790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784045589.291390:0:19790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa400/0x5475624df454df0a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.291396:0:19790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aa400 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045589.291400:0:19790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa400/0x5475624df454df0a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.291409:0:19790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa400/0x5475624df454df0a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.291421:0:19790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff939c93cb7e00) 00010000:00010000:2.0:1784045589.291424:0:19790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784045589.291429:0:19790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa400/0x5475624df454df0a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.291436:0:19790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff939c915aa400/0x5475624df454df0a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.291481:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045589.291484:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784045589.291486:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045589.505797:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045589.505871:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:0.0:1784045589.506533:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863384576 00000100:00100000:0.0:1784045589.506545:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863384576 00000100:00100000:0.0:1784045589.506612:0:18687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863384704 00000100:00100000:0.0:1784045589.506616:0:18687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863384704 00000100:00100000:0.0:1784045589.506641:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:0.0:1784045589.506649:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+8:2397:x1870706863384576:12345-192.168.203.44@tcp:4:dd.0 00002000:00010000:0.0:1784045589.506698:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a566014, atime: 0x6a566013, ctime: 0x6a566014, blocks: 0x0 00010000:00010000:0.0:1784045589.506707:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f27a4147/0x5475624df454df11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.506749:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=545s v=(0 0) 00010000:00010000:0.0:1784045589.506754:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784045589.506761:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f27a4147/0x5475624df454df11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.506777:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f27a4147/0x5475624df454df11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784045589.526984:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784045589.622648:0:18677:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1784045589.622673:0:18677:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1784045589.623812:0:18687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1784045589.623822:0:18687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1784045589.623845:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f27a4147/0x5475624df454df11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.624057:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f27a4147/0x5475624df454df11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.624075:0:18687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f27a4147/0x5475624df454df11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.624084:0:18687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c915aba00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:0.0:1784045589.624090:0:18687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f27a4147/0x5475624df454df11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.624101:0:18687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f27a4147/0x5475624df454df11 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.624252:0:18687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f27a4147/0x5475624df454df11 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784045589.624279:0:18687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f27a4147/0x5475624df454df11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045589.624842:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+6:2397:x1870706863384576:12345-192.168.203.44@tcp:4:dd.0 Request processed in 118183us (119043us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1784045589.624870:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 0 00000100:00100000:2.0:1784045589.624910:0:18687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:2.0:1784045589.624924:0:18687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2397:x1870706863384704:12345-192.168.203.44@tcp:4:dd.0 00002000:00010000:2.0:1784045589.624976:0:18687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a566014, atime: 0x6a566013, ctime: 0x6a566014, blocks: 0x2000 00010000:00010000:2.0:1784045589.624984:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd30cffc/0x5475624df454df18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.624998:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=545s v=(0 0) 00010000:00010000:2.0:1784045589.625002:0:18687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784045589.625009:0:18687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd30cffc/0x5475624df454df18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.625024:0:18687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd30cffc/0x5475624df454df18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784045589.663667:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b8199a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873949952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784045589.663773:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045589.664299:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873949952 00000100:00100000:0.0:1784045589.664309:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873949952 00000100:00100000:0.0:1784045589.665145:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784045589.665166:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873949952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784045589.665213:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 29810368 pending 3485696 free 3923505152 avail 3687763968 00000100:00100000:0.0:1784045589.665303:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf552300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873949952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045589.665312:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784045589.668357:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b8199a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873949952:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1784045589.702518:0:18677:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1784045589.702867:0:18687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1784045589.702873:0:18687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1784045589.702894:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd30cffc/0x5475624df454df18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.702910:0:18687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd30cffc/0x5475624df454df18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.702919:0:18687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd30cffc/0x5475624df454df18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.702942:0:18687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff939c80031c00 already unused, calling callback (ffffffffc0dc5230) 00010000:00010000:2.0:1784045589.702947:0:18687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd30cffc/0x5475624df454df18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.702957:0:18687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd30cffc/0x5475624df454df18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.702979:0:18687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd30cffc/0x5475624df454df18 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784045589.702987:0:18687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd30cffc/0x5475624df454df18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784045589.703123:0:18687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2397:x1870706863384704:12345-192.168.203.44@tcp:4:dd.0 Request processed in 78197us (197245us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1784045589.703134:0:18687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 1 00000100:00100000:2.0:1784045590.163984:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784045590.164017:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873950080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045590.164110:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045590.164318:0:17913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873950080 00000100:00100000:3.0:1784045590.164329:0:17913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873950080 00000100:00100000:3.0:1784045590.164395:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784045590.164407:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873950080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784045590.164481:0:17913:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1784045590.164548:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1870706873950080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045590.164556:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784045590.164715:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1870706873950080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784045590.165437:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873950208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784045590.165521:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045590.166103:0:17178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873950208 00000100:00100000:3.0:1784045590.166112:0:17178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873950208 00000100:00100000:3.0:1784045590.166169:0:17178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784045590.166180:0:17178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873950208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784045590.166230:0:17178:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1784045590.166301:0:17178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873950208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045590.166322:0:17178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784045590.166491:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939b81999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873950208:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1784045590.550225:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045590.676438:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784045590.676491:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873950336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784045590.676586:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045590.677672:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873950336 00000100:00100000:3.0:1784045590.677684:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873950336 00000100:00100000:3.0:1784045590.678082:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784045590.678097:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873950336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784045590.678133:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:3.0:1784045590.678246:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf551f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873950336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045590.678255:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1784045590.678328:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784045590.678587:0:3626:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1784045590.678596:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff939b836d0700, transno 8589934596 00000004:00080000:0.0:1784045590.678617:0:3626:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1784045590.678673:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873950336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784045591.571679:0:19790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784045591.824984:0:20354:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:3.0:1784045592.339682:0:17206:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784045592.339691:0:17206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784045592.339713:0:17206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784045592.339724:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1784045592.595727:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784045593.238625:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784045593.238649:0:3625:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873950464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784045593.238716:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045593.238978:0:18684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873950464 00000100:00100000:3.0:1784045593.238985:0:18684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873950464 00000100:00100000:3.0:1784045593.239044:0:18684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784045593.239053:0:18684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cbf550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873950464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784045593.239080:0:18684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784045593.239124:0:18684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cbf550380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1870706873950464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045593.239131:0:18684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784045593.239152:0:3623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939c812afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873950592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045593.239187:0:3623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784045593.239218:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045593.239227:0:18685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873950592 00000100:00100000:3.0:1784045593.239230:0:18685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873950592 00000100:00100000:3.0:1784045593.239275:0:18685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784045593.239280:0:18685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873950592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784045593.239290:0:18685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1784045593.239317:0:18685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1870706873950592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045593.239322:0:18685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1784045593.239332:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784045593.239357:0:3623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939c812afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1870706873950592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784045593.239381:0:3625:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf552680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1870706873950464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784045593.239757:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873950976:0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.239791:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045593.239827:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873951488:0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.239851:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045593.239869:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873952000:0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.239889:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045593.239918:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784045593.239923:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873950848:0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.239948:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045593.239973:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873951360:0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.239995:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045593.240012:0:3626:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873951872:0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.240047:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784045593.240075:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873951488 00000100:00100000:0.0:1784045593.240079:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873951488 00000100:00100000:0.0:1784045593.240107:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873952000 00000100:00100000:0.0:1784045593.240110:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873952000 00000100:00100000:0.0:1784045593.240127:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873951872 00000100:00100000:0.0:1784045593.240130:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873951872 00000100:00100000:0.0:1784045593.240144:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784045593.240149:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873951488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.240198:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1870706873951488:12345-0@lo:400:kworker.0 Request processed in 48us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045593.240205:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784045593.240221:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784045593.240226:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873952000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.240253:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1870706873952000:12345-0@lo:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045593.240259:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784045593.240271:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784045593.240276:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873951872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.240302:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1870706873951872:12345-0@lo:400:kworker.0 Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045593.240318:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784045593.240337:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873950848 00000100:00100000:0.0:1784045593.240340:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873950848 00000100:00100000:0.0:1784045593.240362:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784045593.240367:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b8199a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873950848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.240397:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b8199a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873950848:12345-0@lo:400:kworker.0 Request processed in 30us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045593.240403:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784045593.240421:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873950976 00000100:00100000:0.0:1784045593.240424:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873950976 00000100:00100000:0.0:1784045593.240479:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873951360 00000100:00100000:0.0:1784045593.240483:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873951360 00000100:00100000:0.0:1784045593.240503:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784045593.240510:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873950976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.240540:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1870706873950976:12345-0@lo:400:kworker.0 Request processed in 31us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045593.240548:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784045593.240559:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784045593.240565:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b81999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873951360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.240590:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b81999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1870706873951360:12345-0@lo:400:kworker.0 Request processed in 25us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045593.240596:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784045593.240632:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873950848:0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.240643:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf550000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1870706873951360:0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.240652:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1870706873951872:0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.240672:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1870706873950976:0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.240680:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1870706873951488:0@lo:400:kworker.0 00010000:00080000:0.0:1784045593.240692:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf551500 x1870706873952000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784045593.240701:0:3626:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf551500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1870706873952000:0@lo:400:kworker.0 00000100:00100000:3.0:1784045593.241003:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c25407c2-0928-423d-881e-1585e6e3cc3c:3624:1870706873950720:0@lo:400:kworker.0 00000100:00100000:3.0:1784045593.241050:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045593.241082:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873951232:0@lo:400:kworker.0 00000100:00100000:3.0:1784045593.241104:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045593.241123:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873951744:0@lo:400:kworker.0 00000100:00100000:3.0:1784045593.241142:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045593.241161:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784045593.241167:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873951104:0@lo:400:kworker.0 00000100:00100000:3.0:1784045593.241202:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045593.241221:0:3624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff939cbf550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873951616:0@lo:400:kworker.0 00000100:00100000:3.0:1784045593.241238:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784045593.241262:0:17913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873951232 00000100:00100000:3.0:1784045593.241267:0:17913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873951232 00000100:00100000:3.0:1784045593.241293:0:17913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784045593.241299:0:17913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873951232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045593.241338:0:17913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1870706873951232:12345-0@lo:400:kworker.0 Request processed in 40us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045593.241352:0:17913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784045593.241369:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873951744 00000100:00100000:3.0:1784045593.241373:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873951744 00000100:00100000:3.0:1784045593.241394:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873951104 00000100:00100000:3.0:1784045593.241396:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873951104 00000100:00100000:3.0:1784045593.241407:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873951616 00000100:00100000:3.0:1784045593.241409:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873951616 00000100:00100000:3.0:1784045593.241420:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784045593.241425:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873951744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045593.241479:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1870706873951744:12345-0@lo:400:kworker.0 Request processed in 53us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045593.241485:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784045593.241496:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784045593.241502:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873951104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045593.241528:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1870706873951104:12345-0@lo:400:kworker.0 Request processed in 26us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045593.241534:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784045593.241545:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784045593.241551:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939c812ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873951616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784045593.241575:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939c812ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1870706873951616:12345-0@lo:400:kworker.0 Request processed in 25us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045593.241581:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1784045593.241602:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045593.241607:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784045593.241609:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784045593.241638:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1870706873951104:0@lo:400:kworker.0 00000100:00100000:3.0:1784045593.241660:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1870706873951616:0@lo:400:kworker.0 00000100:00100000:3.0:1784045593.241669:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf551880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1870706873951232:0@lo:400:kworker.0 00010000:00080000:3.0:1784045593.241679:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff939cbf553b80 x1870706873951744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784045609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784045593.241688:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1870706873951744:0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.241900:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706873950720 00000100:00100000:0.0:1784045593.241905:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706873950720 00000100:00100000:0.0:1784045593.241947:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784045593.241953:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+24:3624:x1870706873950720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784045593.241996:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c25407c2-0928-423d-881e-1585e6e3cc3c+24:3624:x1870706873950720:12345-0@lo:400:kworker.0 Request processed in 43us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1784045593.242002:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784045593.242260:0:3624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff939cbf552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c25407c2-0928-423d-881e-1585e6e3cc3c:3624:1870706873950720:0@lo:400:kworker.0 00010000:00010000:3.0:1784045593.619737:0:17161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784045593.800196:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045593.800240:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045593.800269:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045593.800287:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045593.800303:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045593.800342:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045593.800366:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045593.800383:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045593.800405:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.44@tcp (source: 12345-192.168.203.44@tcp) 00000100:00100000:2.0:1784045593.800434:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863385344 00000100:00100000:2.0:1784045593.800460:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863385344 00000100:00100000:2.0:1784045593.800520:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863385856 00000100:00100000:2.0:1784045593.800523:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863385856 00000100:00100000:2.0:1784045593.800536:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863385216 00000100:00100000:2.0:1784045593.800539:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863385216 00000100:00100000:2.0:1784045593.800550:0:19969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863385728 00000100:00100000:2.0:1784045593.800552:0:19969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863385728 00000100:00100000:2.0:1784045593.800566:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:2.0:1784045593.800575:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2394:x1870706863385344:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045593.800646:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2394:x1870706863385344:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 72us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045593.800654:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 27 00000100:00100000:2.0:1784045593.800669:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:2.0:1784045593.800675:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2394:x1870706863385856:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045593.800699:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2394:x1870706863385856:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045593.800704:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 28 00000100:00100000:2.0:1784045593.800728:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:2.0:1784045593.800733:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b84c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2394:x1870706863385216:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045593.800757:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b84c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2394:x1870706863385216:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045593.800762:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 29 00000100:00100000:2.0:1784045593.800771:0:19969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:2.0:1784045593.800777:0:19969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b84c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2394:x1870706863385728:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:2.0:1784045593.800795:0:19969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b84c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2394:x1870706863385728:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 19us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784045593.800800:0:19969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 30 00000100:00100000:3.0:1784045593.802282:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863384832 00000100:00100000:3.0:1784045593.802295:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863384832 00000100:00100000:3.0:1784045593.802360:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 168 00000100:00100000:3.0:1784045593.802369:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939cb6de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+13:2394:x1870706863384832:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045593.802427:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939cb6de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0f86ebe-963e-4824-a274-0f8b57132670+13:2394:x1870706863384832:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 59us (2241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045593.802434:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 168 00000100:00100000:3.0:1784045593.802483:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863385088 00000100:00100000:3.0:1784045593.802487:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863385088 00000100:00100000:3.0:1784045593.802509:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863385600 00000100:00100000:3.0:1784045593.802512:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863385600 00000100:00100000:3.0:1784045593.802524:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863384960 00000100:00100000:3.0:1784045593.802527:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863384960 00000100:00100000:3.0:1784045593.802541:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870706863385472 00000100:00100000:3.0:1784045593.802544:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870706863385472 00000100:00100000:3.0:1784045593.802557:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:3.0:1784045593.802563:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2394:x1870706863385088:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045593.802592:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+5:2394:x1870706863385088:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 30us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045593.802610:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 66 00000100:00100000:3.0:1784045593.802623:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:3.0:1784045593.802630:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b831f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2394:x1870706863385600:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045593.802655:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b831f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+5:2394:x1870706863385600:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 25us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045593.802660:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 67 00000100:00100000:3.0:1784045593.802671:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:3.0:1784045593.802677:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b84c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+22:2394:x1870706863384960:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045593.802702:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b84c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5c4ec1df-89f5-44e3-9b84-9820a7989c32+22:2394:x1870706863384960:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 26us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045593.802707:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 68 00000100:00100000:3.0:1784045593.802718:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00100000:3.0:1784045593.802724:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff939b84c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:2394:x1870706863385472:12345-192.168.203.44@tcp:400:kworker.0 00000100:00100000:3.0:1784045593.802744:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff939b84c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:afbadc4e-7e5b-40f4-aa1f-f579a0ff2353+6:2394:x1870706863385472:12345-192.168.203.44@tcp:400:kworker.0 Request processed in 20us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784045593.802750:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.44@tcp, seq: 69 00000100:00080000:3.0:1784045593.802786:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784045593.802791:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784045593.802793:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784045593.802796:0:17168:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 Debug log: 43207 lines, 43207 kept, 0 dropped, 0 bad.